EVAL1_SPC2 - Details for Query 6

Details for Query 6

Submitted Time: 2025/09/15 13:17:25
Duration: 0.6 s
Succeeded Jobs: 8

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand number of written files: 6 written output: 232.9 KiB number of output rows: 6,945 number of dynamic part: 0"]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n1.4 s (194 ms, 240 ms, 262 ms (stage 9.0: task 17))"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="Scan ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd) number of output rows: 6,945"]; } 2->0; 3->2; }

Execute InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a, false, Parquet, [path=file:///data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a], ErrorIfExists, [Niveau+code, ATC_code, ATC_codePere, Libell%C3%A9+anglais, Libell%C3%A9+fran%C3%A7ais, Commentaires, Cr%C3%A9ation, Modification, Inactivation, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT]

Project [Niveau code#1109 AS Niveau+code#1147, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112 AS Libell%C3%A9+anglais#1180, Libellé français#1113 AS Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114, Création#1115 AS Cr%C3%A9ation#1213, Modification#1116, Inactivation#1117, file:/data/input/depot/excel/execution/693D1968_C0BA_4D71_AD27_BFE39CB5F506/current/ATC_2025_02_28.xls AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1246]

Scan ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd) [Libellé anglais#1112,Création#1115,Inactivation#1117,Niveau code#1109,Modification#1116,Commentaires#1114,ATC_code#1110,Libellé français#1113,ATC_codePere#1111] PushedFilters: [], ReadSchema: struct<Libellé anglais:string,Création:string,Inactivation:string,Niveau code:string,Modification...

WholeStageCodegen (1)

Details

== Parsed Logical Plan ==
InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a, false, Parquet, [path=file:///data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a], ErrorIfExists, [Niveau+code, ATC_code, ATC_codePere, Libell%C3%A9+anglais, Libell%C3%A9+fran%C3%A7ais, Commentaires, Cr%C3%A9ation, Modification, Inactivation, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT]
+- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1224, Inactivation#1235, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136 AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1246]
   +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1224, Inactivation#1117 AS Inactivation#1235, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
      +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1116 AS Modification#1224, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
         +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Création#1115 AS Cr%C3%A9ation#1213, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
            +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114 AS Commentaires#1202, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
               +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libellé français#1113 AS Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                  +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libellé anglais#1112 AS Libell%C3%A9+anglais#1180, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                     +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1111 AS ATC_codePere#1169, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                        +- Project [Niveau+code#1147, ATC_code#1110 AS ATC_code#1158, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                           +- Project [Niveau code#1109 AS Niveau+code#1147, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                              +- Project [Niveau code#1109, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, file:/data/input/depot/excel/execution/693D1968_C0BA_4D71_AD27_BFE39CB5F506/current/ATC_2025_02_28.xls AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                                 +- Relation[Niveau code#1109,ATC_code#1110,ATC_codePere#1111,Libellé anglais#1112,Libellé français#1113,Commentaires#1114,Création#1115,Modification#1116,Inactivation#1117] ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd)

== Analyzed Logical Plan ==

InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a, false, Parquet, [path=file:///data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a], ErrorIfExists, [Niveau+code, ATC_code, ATC_codePere, Libell%C3%A9+anglais, Libell%C3%A9+fran%C3%A7ais, Commentaires, Cr%C3%A9ation, Modification, Inactivation, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT]
+- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1224, Inactivation#1235, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136 AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1246]
   +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1224, Inactivation#1117 AS Inactivation#1235, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
      +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Cr%C3%A9ation#1213, Modification#1116 AS Modification#1224, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
         +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1202, Création#1115 AS Cr%C3%A9ation#1213, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
            +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114 AS Commentaires#1202, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
               +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libell%C3%A9+anglais#1180, Libellé français#1113 AS Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                  +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1169, Libellé anglais#1112 AS Libell%C3%A9+anglais#1180, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                     +- Project [Niveau+code#1147, ATC_code#1158, ATC_codePere#1111 AS ATC_codePere#1169, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                        +- Project [Niveau+code#1147, ATC_code#1110 AS ATC_code#1158, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                           +- Project [Niveau code#1109 AS Niveau+code#1147, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                              +- Project [Niveau code#1109, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112, Libellé français#1113, Commentaires#1114, Création#1115, Modification#1116, Inactivation#1117, file:/data/input/depot/excel/execution/693D1968_C0BA_4D71_AD27_BFE39CB5F506/current/ATC_2025_02_28.xls AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1136]
                                 +- Relation[Niveau code#1109,ATC_code#1110,ATC_codePere#1111,Libellé anglais#1112,Libellé français#1113,Commentaires#1114,Création#1115,Modification#1116,Inactivation#1117] ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd)

== Optimized Logical Plan ==
InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a, false, Parquet, [path=file:///data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a], ErrorIfExists, [Niveau+code, ATC_code, ATC_codePere, Libell%C3%A9+anglais, Libell%C3%A9+fran%C3%A7ais, Commentaires, Cr%C3%A9ation, Modification, Inactivation, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT]
+- Project [Niveau code#1109 AS Niveau+code#1147, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112 AS Libell%C3%A9+anglais#1180, Libellé français#1113 AS Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114, Création#1115 AS Cr%C3%A9ation#1213, Modification#1116, Inactivation#1117, file:/data/input/depot/excel/execution/693D1968_C0BA_4D71_AD27_BFE39CB5F506/current/ATC_2025_02_28.xls AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1246]
   +- Relation[Niveau code#1109,ATC_code#1110,ATC_codePere#1111,Libellé anglais#1112,Libellé français#1113,Commentaires#1114,Création#1115,Modification#1116,Inactivation#1117] ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd)

== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a, false, Parquet, [path=file:///data/input/depot/excel/cache/693D1968_C0BA_4D71_AD27_BFE39CB5F506_993619b8182e78e993058d2cc4fe3e35/ATC_2025_02_28.xls_f733f5c77c16059cd316d9a23eb66f4a], ErrorIfExists, [Niveau+code, ATC_code, ATC_codePere, Libell%C3%A9+anglais, Libell%C3%A9+fran%C3%A7ais, Commentaires, Cr%C3%A9ation, Modification, Inactivation, 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT]
+- *(1) Project [Niveau code#1109 AS Niveau+code#1147, ATC_code#1110, ATC_codePere#1111, Libellé anglais#1112 AS Libell%C3%A9+anglais#1180, Libellé français#1113 AS Libell%C3%A9+fran%C3%A7ais#1191, Commentaires#1114, Création#1115 AS Cr%C3%A9ation#1213, Modification#1116, Inactivation#1117, file:/data/input/depot/excel/execution/693D1968_C0BA_4D71_AD27_BFE39CB5F506/current/ATC_2025_02_28.xls AS 693D1968_C0BA_4D71_AD27_BFE39CB5F506HEADER_COL_DETAIL_DEPOT#1246]
   +- *(1) Scan ExcelRelation(com.crealytics.spark.excel.CellRangeAddressDataLocator@789b916d,true,false,false,false,false,false,None,None,10,com.crealytics.spark.excel.DefaultWorkbookReader@12fc39fd) [Libellé anglais#1112,Création#1115,Inactivation#1117,Niveau code#1109,Modification#1116,Commentaires#1114,ATC_code#1110,Libellé français#1113,ATC_codePere#1111] PushedFilters: [], ReadSchema: struct<Libellé anglais:string,Création:string,Inactivation:string,Niveau code:string,Modification...