Stages for All Jobs

Fair Scheduler Pools (1)

Pool Name Minimum Share Pool Weight Active Stages Running Tasks Scheduling Mode
default 1 1 0 0 FAIR

Completed Stages (85)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
96 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:48:35 4 ms
1/1
59.0 B
94 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:48:35 0.2 s
1/1
341.5 KiB
93 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:48:35 0.2 s
1/1
341.5 KiB59.0 B
92 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:48:35 13 ms
1/1
91 default
DataFrameCommonJob_dataExecSummaryOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:48:35 15 ms
1/1
90 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:45:42 11 ms
1/1
59.0 B
88 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:45:42 0.4 s
1/1
341.5 KiB
87 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:45:42 0.4 s
1/1
341.5 KiB59.0 B
86 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:45:41 14 ms
1/1
85 default
DataFrameCommonJob_dataExecSummaryOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:45:41 14 ms
1/1
84 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:45:02 27 ms
7/7
23.6 KiB
82 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:45:02 90 ms
1/1
27.3 KiB23.6 KiB
81 default
DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 +details
2025/09/15 13:45:02 17 ms
1/1
80 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:45:00 13 ms
1/1
83.0 B
78 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:45:00 25 ms
1/1
27.3 KiB83.0 B
77 default
DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 +details
2025/09/15 13:45:00 14 ms
1/1
76 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:43:42 0.1 s
7/7
7.1 KiB
74 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:43:41 0.2 s
1/1
21.8 KiB7.1 KiB
73 default
DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 +details
2025/09/15 13:43:41 13 ms
1/1
72 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:43:39 33 ms
1/1
86.0 B
70 default
DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:43:39 98 ms
1/1
21.8 KiB86.0 B
69 default
DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 +details
2025/09/15 13:43:39 11 ms
1/1
68 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:43:15 21 ms
1/1
341.5 KiB
67 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:43:15 17 ms
1/1
59.0 B
65 default
DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 +details
2025/09/15 13:43:15 11 ms
1/1
13.8 KiB59.0 B
64 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:43:15 13 ms
1/1
63 default
DataFrameCommonJob_dataExecSummaryOnCreation parquet at CommonJob.java:47 +details
2025/09/15 13:43:15 14 ms
1/1
62 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:42:38 0.5 s
1/1
2.4 MiB2.3 MiB
61 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:42:38 12 ms
1/1
60 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:42:38 0.2 s
1/1
445.8 KiB428.5 KiB
59 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:42:37 15 ms
1/1
58 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:42:37 0.3 s
2/2
7.1 MiB490.4 KiB
57 default
PersistFrame csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:42:37 90 ms
2/2
7.1 MiB
56 default
PersistFrame csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:42:37 17 ms
1/1
68.0 KiB
55 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:37:47 6 ms
1/1
118.0 B
53 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:37:47 32 ms
1/1
260.0 KiB
52 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:37:47 80 ms
2/2
7.1 MiB118.0 B
51 default
DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:46 0.1 s
2/2
7.1 MiB
50 default
DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:46 0.1 s
2/2
7.1 MiB
49 default
DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:46 7 ms
1/1
68.0 KiB
48 default
DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:46 13 ms
1/1
68.0 KiB
47 default
DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:37:11 32 ms
1/1
132.0 KiB
46 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:11 0.1 s
2/2
7.1 MiB
45 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:11 10 ms
1/1
68.0 KiB
44 default
DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:37:01 17 ms
1/1
132.0 KiB
43 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:01 0.2 s
2/2
7.1 MiB
42 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:37:01 10 ms
1/1
68.0 KiB
41 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:33:36 0.1 s
1/1
445.8 KiB428.5 KiB
40 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:33:36 12 ms
1/1
39 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:33:24 23 ms
1/1
445.8 KiB
38 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:33:24 10 ms
1/1
37 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:33:24 5 ms
1/1
59.0 B
35 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:33:24 11 ms
1/1
15.1 KiB59.0 B
34 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1391 +details
2025/09/15 13:33:23 14 ms
1/1
33 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1389 +details
2025/09/15 13:33:16 7 s
1/1
6.7 MiB430.7 KiB
32 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:30:47 0.1 s
1/1
344.0 KiB327.8 KiB
31 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:30:46 11 ms
1/1
30 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:30:43 0.1 s
6/6
271.1 KiB225.8 KiB
29 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:30:43 13 ms
1/1
28 default
PersistFrame parquet at PersistJob.java:35 +details
2025/09/15 13:30:21 0.7 s
1/1
2.4 MiB2.3 MiB
27 default
PersistFrame parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:30:21 13 ms
1/1
26 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:30:07 74 ms
1/1
2.4 MiB
25 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:30:07 14 ms
1/1
24 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:30:07 8 ms
1/1
59.0 B
22 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:30:06 17 ms
1/1
22.4 KiB59.0 B
21 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1391 +details
2025/09/15 13:30:06 13 ms
1/1
20 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1389 +details
2025/09/15 13:29:40 26 s
1/1
6.7 MiB2.4 MiB
19 default
DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:18:39 76 ms
1/1
132.0 KiB
18 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:18:38 0.2 s
1/1
3.7 MiB
17 default
DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:314 +details
2025/09/15 13:18:38 47 ms
1/1
68.0 KiB
16 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:17:26 18 ms
1/1
47.1 KiB
15 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:17:26 23 ms
1/1
48.7 KiB
14 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:17:26 15 ms
1/1
13 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:17:26 11 ms
1/1
354.0 B
11 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:17:26 49 ms
6/6
43.6 KiB354.0 B
10 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1391 +details
2025/09/15 13:17:25 29 ms
1/1
9 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1389 +details
2025/09/15 13:17:25 0.4 s
6/6
232.9 KiB
8 default
DataFrameCommonJob_checkExcelOncreation aggregate at InferSchema.scala:30 +details
2025/09/15 13:16:25 47 ms
6/6
7 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:12:47 68 ms
1/1
59.0 B
5 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/09/15 13:12:46 0.1 s
1/1
15.1 KiB59.0 B
4 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:12:46 0.3 s
1/1
344.0 KiB
3 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:1326 +details
2025/09/15 13:12:46 28 ms
1/1
2 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:1391 +details
2025/09/15 13:12:45 0.1 s
1/1
1 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:1389 +details
2025/09/15 13:12:40 5 s
1/1
656.7 KiB328.8 KiB
0 default
DataFrameCommonJob_checkExcel takeAsList at DataFrameCommonJob.java:145 +details
2025/09/15 13:12:14 0.7 s
1/1

Skipped Stages (12)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
95 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
89 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
83 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
79 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
75 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
71 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
66 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
54 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/2
36 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
23 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
12 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/6
6 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1