Skip to content

Add some general logs per chunk for validation step

Nicola Stoira requested to merge sphnc-313 into main

Example:

[2024-04-22, 16:39:28 CEST] {logging_mixin.py:188} INFO - Start -- QC tool for chunk 1 triggered
[2024-04-22, 16:39:28 CEST] {logging_mixin.py:188} INFO - Start -- QC tool for chunk 3 triggered
[2024-04-22, 16:39:28 CEST] {logging_mixin.py:188} INFO - Start -- QC tool for chunk 2 triggered
[2024-04-22, 16:39:28 CEST] {logging_mixin.py:188} INFO - Start -- QC tool for chunk 0 triggered
[2024-04-22, 16:41:38 CEST] {logging_mixin.py:188} INFO - End -- QC tool for chunk 1 took 0:02:09
[2024-04-22, 16:41:38 CEST] {logging_mixin.py:188} INFO - Start -- Upload data for chunk 1 triggered
[2024-04-22, 16:41:39 CEST] {logging_mixin.py:188} INFO - End -- QC tool for chunk 0 took 0:02:11
[2024-04-22, 16:41:39 CEST] {logging_mixin.py:188} INFO - Start -- Upload data for chunk 0 triggered
[2024-04-22, 16:41:42 CEST] {logging_mixin.py:188} INFO - End -- QC tool for chunk 2 took 0:02:13
[2024-04-22, 16:41:42 CEST] {logging_mixin.py:188} INFO - Start -- Upload data for chunk 2 triggered
[2024-04-22, 16:41:42 CEST] {logging_mixin.py:188} INFO - End -- Upload data for chunk 1 took 0:00:04
[2024-04-22, 16:41:44 CEST] {logging_mixin.py:188} INFO - End -- QC tool for chunk 3 took 0:02:16
[2024-04-22, 16:41:44 CEST] {logging_mixin.py:188} INFO - Start -- Upload data for chunk 3 triggered
[2024-04-22, 16:41:44 CEST] {logging_mixin.py:188} INFO - End -- Upload data for chunk 0 took 0:00:04
[2024-04-22, 16:41:47 CEST] {logging_mixin.py:188} INFO - End -- Upload data for chunk 2 took 0:00:04
[2024-04-22, 16:41:49 CEST] {logging_mixin.py:188} INFO - End -- Upload data for chunk 3 took 0:00:04
Edited by Nicola Stoira

Merge request reports