Skip to content

Update count of patients extracted from database after each chunk

Nicola Stoira requested to merge sphnc-1114 into main
  • After the data for a single chunk is extracted we update the pipeline history table with the total count of extracted patients. As the chunks are processed in parallel this does not give us a real time count because the metadata is updated afterwards, but especially if the patient sizes inside the chunks is different it might give us an early information about the number of processed patients.
  • Enclose the database extraction logic inside a try-except block to that in case of failure we mark the step as FAILED in the pipeline history table.
  • Update /Get_status logic
Edited by Nicola Stoira

Merge request reports

Loading