Documentation

This page contains documentation produced in the DOMS project.

Install Guide for DOMS with Radio/TV

Design

The top level design documentation will be available here.

Packages

Bitstorage

ECM

IP-Role Mapper

Update tracker

DOMSServer

DOMS Server API

DOMSClient

Ingest

Radio-TV Ingester

DOMS-GUI

OAI-PMH handling

Summa integration

Broadcast Extraction Service

DOMS Wowza plugin

APIs

Note: APIs below here are abandoned.

The DOMS-related API documentation is a work in progress.

Data Model

The data model documentation is a work in progress.

Data Provider

GUI Code Docs

Fedora 3 Project

Picture video for wowza

Deployment History

webapp

svn

date

comments

bes

2010-11-10

bes_dev

1308

2010-11-26

vlc-based transcoding

bes_exp

1308

2010-11-26

"Runtimes" for parts of deployment

Useful for those tasks that may be done for deploying DOMS with Radio/TV-recordings and metadata for 2005-2010.

As of 2011-02-11, after updating program mappings, the prod system ritzau database contains (for 2005-2011) a total of 4.883.822 programs. (These are for channels 100fm dk4 dr1 dr2 drbo drhd drk drol drp1 drp2 drp3 drp4b drp4f drp4k drp4k94 drp4mv drp4nj drp4o drp4re drp4s drp5000 drpk drram drup drx kanal4 kanal5 kanal6 novafm radio2 sbsnet tv2c tv2d tv2l tv2news tv2oj tv2radio tv2s tv2sport tv2z voice)

Examples of how long runs and batches have taken:

Run/batch/process

Size of task

Time

Clear metadata in Ritzau Database (thru psql)

4553311 objects

about 39 mins

Not to be done in prod

Clear metadata in Ritzau Database (thru psql)

123499 objects (1 month of metadata)

about 2 mins

Not to be done in prod

Update channel-mappings in Radio/TV GUI

? (Colin finds out)

45 mins for 2.300.000

To be done in prod

Fill Ritzau Database (bart_systemet_mirror.sh)

1 month of metadata

7 mins

To be done partly in prod (?)

Ingest references to recording-files in Radio/TV system (file_ingester.sh)

1 month of recording-files

1.5 mins

To be done in prod

Preingest

546105 xml-files output (21 channels (radio+tv), 2005-2010)

3-4-5 days

To be done in prod

Ingest

objects for 1 preingest-file (2-5 objects pr preingest xml-file)

about 2 secs

To be done in prod

Ingest

274670 preingest-files (about half of 2005-2010)

about 12,5 days

To be done in prod

Summa - harvest (incl. ingest)

-

Ca. 2 poster/sek

To be done in prod

Summa - indexing

-

500-1000 poster/sek

To be done in prod

Rebuild (in prod) of Triple Store & Fedora's database

572343 fedora objects ( = 270856 programs) (avg 2.1 fedora objects per program)

5 hours ( = 303.5 mins)

As done in prod after crash

Documentation (last edited 2011-02-24 15:56:00 by jrg)