Differences between revisions 7 and 8
Revision 7 as of 2011-01-31 12:42:47
Size: 1271
Editor: jrg
Comment:
Revision 8 as of 2011-01-31 12:46:54
Size: 1359
Editor: jrg
Comment:
Deletions are marked like this. Additions are marked like this.
Line 12: Line 12:
 i. Check the corresponding logfiles bartfile_bulk_ingester.debug.log and bartfile_bulk_ingester.error.log. The error log should be empty and the debug log should list all the files ingested.  i. Then: {{{
rm 2009_mpeg.txt 2009_wav.txt 2010_mpeg.txt 2010_wav.txt}}}
i. Check the corresponding logfiles {{{bartfile_bulk_ingester.debug.log}}} and {{{bartfile_bulk_ingester.error.log}}}. The error log should be empty and the debug log should list all the files ingested.

Bulk Ingest of Analogue (BART) files

Done by Maintenance

From DigiTV v.0.5.0, file_ingest.sh ingests both digital and analogue recordings in the DigiTV database. A one-off ingest of all old analogue recordings is also necessary. Functionality for this is implemented in BartFileBulkIngester and the corresponding script bartfile_bulk_ingester.sh. This is new functionality in DigiTV 0.5.0

  1. Download a list of all files to be ingested, as follows.

    wget -O 2009_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.mpeg ; wget -O 2009_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.wav ; wget -O 2010_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.mpeg ; wget -O 2010_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.wav
  2. Ingest:

    bartfile_bulk_ingester.sh 2009_mpeg.txt ; bartfile_bulk_ingester.sh 2009_wav.txt ; bartfile_bulk_ingester.sh 2010_mpeg.txt ; bartfile_bulk_ingester.sh 2010_wav.txt
  3. Then:

    rm 2009_mpeg.txt 2009_wav.txt 2010_mpeg.txt 2010_wav.txt
  4. Check the corresponding logfiles bartfile_bulk_ingester.debug.log and bartfile_bulk_ingester.error.log. The error log should be empty and the debug log should list all the files ingested.

BulkIngestBartFiles (last edited 2011-01-31 13:03:10 by jrg)