|
Size: 892
Comment:
|
Size: 1461
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| == Bulk Ingest of Analogue (BART) files == | = Bulk Ingest of Analogue (BART) files = |
| Line 3: | Line 3: |
| From v.0.5.0, file_ingest.sh ingests both digital and analogue recordings. A one-off ingest of all old analogue recordings is also necessary. Functionality for this is implemented in BartFileBulkIngester and the corresponding script bartfile_bulk_ingester.sh. This is new functionality in DigiTV 0.5.0 |
== Done by Maintenance == ''From DigiTV v.0.5.0, file_ingest.sh ingests both digital and analogue recordings in the DigiTV database. A one-off ingest of all old analogue recordings is also necessary. Functionality for this is implemented in !BartFileBulkIngester and the corresponding script {{{bartfile_bulk_ingester.sh}}}. This is new functionality in DigiTV 0.5.0'' |
| Line 7: | Line 8: |
| i. Download a list of all files to be ingested. For example all video files from 2009: {{{wget -O 2009_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*2009*mpeg}}} i. Ingest: {{{bartfile_bulk_ingester.sh 2009_mpeg.txt}}} i. Check the corresponding logfiles bartfile_bulk_ingester.debug.log and bartfile_bulk_ingester.error.log. The error log should be empty and the debug log should list all the files ingested. i. Repeat with audio files from the same interval, substituting "wav" for "mpeg" in the above recipe. |
In STAGE, on the machine where DigiTV is installed, in directory {{{digitv/bin}}} do the following i. Download a list of all files to be ingested, as follows. {{{ wget -O 2009_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.mpeg ; wget -O 2009_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.wav ; wget -O 2010_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.mpeg ; wget -O 2010_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.wav}}} i. Ingest: {{{ bartfile_bulk_ingester.sh 2009_mpeg.txt ; bartfile_bulk_ingester.sh 2009_wav.txt ; bartfile_bulk_ingester.sh 2010_mpeg.txt ; bartfile_bulk_ingester.sh 2010_wav.txt}}} i. Then: {{{ rm 2009_mpeg.txt 2009_wav.txt 2010_mpeg.txt 2010_wav.txt}}} i. Check the corresponding logfiles {{{bartfile_bulk_ingester.debug.log}}} and {{{bartfile_bulk_ingester.error.log}}}. The error log should be empty and the debug log should list all the files ingested. |
Bulk Ingest of Analogue (BART) files
Done by Maintenance
From DigiTV v.0.5.0, file_ingest.sh ingests both digital and analogue recordings in the DigiTV database. A one-off ingest of all old analogue recordings is also necessary. Functionality for this is implemented in BartFileBulkIngester and the corresponding script bartfile_bulk_ingester.sh. This is new functionality in DigiTV 0.5.0
In STAGE, on the machine where DigiTV is installed, in directory digitv/bin do the following
Download a list of all files to be ingested, as follows.
wget -O 2009_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.mpeg ; wget -O 2009_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20090301*_20090308*.wav ; wget -O 2010_mpeg.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.mpeg ; wget -O 2010_wav.txt http://pluto.statsbiblioteket.dk/~bart/get_url.cgi?*_20100301*_20100308*.wav
Ingest:
bartfile_bulk_ingester.sh 2009_mpeg.txt ; bartfile_bulk_ingester.sh 2009_wav.txt ; bartfile_bulk_ingester.sh 2010_mpeg.txt ; bartfile_bulk_ingester.sh 2010_wav.txt
Then:
rm 2009_mpeg.txt 2009_wav.txt 2010_mpeg.txt 2010_wav.txt
Check the corresponding logfiles bartfile_bulk_ingester.debug.log and bartfile_bulk_ingester.error.log. The error log should be empty and the debug log should list all the files ingested.