You signed in with another tab or window.Reload to refresh your session.You signed out in another tab or window.Reload to refresh your session.You switched accounts on another tab or window.Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+26-2Lines changed: 26 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,9 +11,9 @@ DevOps-Eval is a comprehensive evaluation suite specifically designed for founda
11
11
12
12
📚 This repo contains questions and exercises related to DevOps, including the AIOps.
13
13
14
-
🔥️ There are currently**4850** multiple-choice questions spanning 8 diverse general categories, as shown[below](images/data_info.png).
14
+
💥️ There are currently**4850** multiple-choice questions spanning 8 diverse general categories, as shown[below](images/data_info.png).
15
15
16
-
💥 There are a total of**2200** samples in the AIOps subcategory, covering scenarios such as**log parsing**,**time series anomaly detection**,**time series classification**,**and root cause analysis**.
16
+
🔥 There are a total of**2200** samples in the AIOps subcategory, covering scenarios such as**log parsing**,**time series anomaly detection**,**time series classification**,**and root cause analysis**.
409:11:16,012WARN Cannotopen channel to3 at election address/10.10.34.13:3888
148
+
516:37:13,837WARN Cannotopen channel to2 at election address/10.10.34.12:3888
149
+
609:09:16,008WARN Cannotopen channel to3 at election address/10.10.34.13:3888
150
+
715:27:03,681WARN Cannotopen channel to3 at election address/10.10.34.13:3888
151
+
The first three parts of the log are index, timestamp,and log level. Without considering these three parts, Here we assume that the variablesin the logs are representedas'<*>', separated by spaces between tokens. Whatis the specific log templatefor the above logs?
C: Received connection request/<*>:<*> 和 Interrupting SendWorker
155
+
D: Cannotopen channel to<*> at election address/<*>:<*> 和*******GOODBYE/<*>:<*>********
156
+
answer: D
157
+
explanation: The log includes the fixed template fragments"Cannot open channel to <> at election address /<>:<>"and"****** GOODBYE /<>:<> ********," both of which appearin option D. Meanwhile, the template fragmentsin the other options donot match the contentin the log. Therefore, option Dis the most consistentwith the log template.
158
+
```
159
+
136
160
137
161
## 🚀 How to Evaluate
138
162
If you need to test your own huggingface-formatted model, the overall steps areas follows: