• BulkIngestBartFiles

Bulk Ingest of Analogue (BART) files

Done by Maintenance

From DigiTV v.0.5.0, file_ingest.sh ingests both digital and analogue recordings in the DigiTV database. A one-off ingest of all old analogue recordings is also necessary. Functionality for this is implemented in BartFileBulkIngester and the corresponding script bartfile_bulk_ingester.sh. This is new functionality in DigiTV 0.5.0

In STAGE, on the machine where DigiTV is installed, in directory digitv/bin do the following

1. Download a list of all files to be ingested, as follows.

   wget -O 2009_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_2009*.mpeg ; wget -O 2009_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_2009*.wav ; wget -O 2010_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_2010*.mpeg ; wget -O 2010_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_2010*.wav

2. Ingest:

   ./bartfile_bulk_ingester.sh 2009_mpeg.txt ; ./bartfile_bulk_ingester.sh 2009_wav.txt ; ./bartfile_bulk_ingester.sh 2010_mpeg.txt ; ./bartfile_bulk_ingester.sh 2010_wav.txt

3. Then:

   rm 2009_mpeg.txt 2009_wav.txt 2010_mpeg.txt 2010_wav.txt

4. Check the corresponding logfiles bartfile_bulk_ingester.error.log and bartfile_bulk_ingester.debug.log. The error log should be empty and the debug log should list all the files ingested.