You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 3cacfdb
Browse filesBrowse the repository at this point in the historyBrowse files
fix(topology): clarify disk buffer lifecycle messages
List each lifecycle counter event in the changelog with when it fires
and what it means. Explain that unavailable buffer usage means a disk
buffer writer was busy. Remove a semicolon from the unreferenced buffer
warning and pass the usage snapshot through directly when emitting the
replacement event.
Vector now detects unreferenced disk buffers and reports disk-buffer lifecycle events during configuration reloads through logs and the `topology_disk_buffer_lifecycle_events_total` counter.
1
+
Vector now reports disk buffer lifecycle events during startup and configuration reloads. Each event is logged and increments the `topology_disk_buffer_lifecycle_events_total` counter with an `event` tag:
2
+
3
+
-`removed`: A removed sink still had data in its disk buffer, or Vector could not read how much data it held. The log says whether the sink's current instance keeps draining the buffer in the background or whether the reload waits for it to finish.
4
+
-`replacement_unreferenced`: A changed sink no longer uses its previous disk buffer. If the reload succeeds, the new sink will not read any data left in the old buffer.
5
+
-`unreferenced`: A disk buffer in the data directory is not used by the current configuration. It may still be draining through a detached sink instance. If not, any data it holds is not being processed.
Copy file name to clipboardExpand all lines: src/internal_events/disk_buffer.rs
+4-4Lines changed: 4 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -26,10 +26,10 @@ impl InternalEvent for TopologyDiskBufferRemoved<'_> {
26
26
"Removing sink with attached disk buffer containing buffered bytes. Configuration reload will wait for its current instance to drain the buffer."
27
27
}
28
28
(false,true) => {
29
-
"Removing sink with attached disk buffer whose buffered-byte count is unavailable. Its current instance will continue draining in the background until the buffer is empty or Vector shuts down."
29
+
"Removing sink with attached disk buffer. A disk buffer writer was busy writing or waiting for free space, so the buffer's usage could not be read. Its current instance will continue draining in the background until the buffer is empty or Vector shuts down."
30
30
}
31
31
(false,false) => {
32
-
"Removing sink with attached disk buffer whose buffered-byte count is unavailable. Configuration reload will wait for its current instance to drain the buffer."
32
+
"Removing sink with attached disk buffer. A disk buffer writer was busy writing or waiting for free space, so the buffer's usage could not be read. Configuration reload will wait for its current instance to drain the buffer."
33
33
}
34
34
};
35
35
ifletSome(usage) = self.usage{
@@ -90,7 +90,7 @@ impl InternalEvent for TopologyDiskBufferReplacementUnreferenced<'_> {
90
90
buffer_dirs = ?self.buffer_dirs,
91
91
new_buffer_dirs = ?self.new_buffer_dirs,
92
92
usage_unavailable = true,
93
-
message = "Replacement sink does not use the previous disk buffer, and its buffered-byte count is unavailable. If reload succeeds, any buffered bytes will be left unreferenced.",
93
+
message = "Replacement sink does not use the previous disk buffer. A disk buffer writer was busy writing or waiting for free space, so the buffer's usage could not be read. If reload succeeds, any buffered bytes will be left unreferenced.",
94
94
),
95
95
}
96
96
counter!(
@@ -112,7 +112,7 @@ impl InternalEvent for TopologyDiskBufferUnreferenced<'_> {
message = "Found disk buffer not referenced by the current configuration. It may still be draining through a detached sink instance; otherwise its buffered bytes are not being processed.",
115
+
message = "Found disk buffer not referenced by the current configuration. It may still be draining through a detached sink instance. If not, any buffered bytes it holds are not being processed.",
0 commit comments