Differences between revisions 16 and 93 (spanning 77 versions)
Revision 16 as of 2011-01-19 08:50:27
Size: 2709
Comment:
Revision 93 as of 2011-02-09 16:50:38
Size: 5375
Editor: jrg
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
|| '''Step''' || '''Answer (yes/no)''' || '''If no, what went wrong?''' ||
|| [[RadioTVStageTestStartTomcat|Start tomcat - is the DOMS running?]] || || ||
|| [[RadioTVStageTestStartIngester|Start the ingester - does it run properly?]]|| || ||
|| [[RadioTVStageTestStartPreingester|Start the pre-ingester - does it run properly?]] || to be tested.. || ||
|| [[RadioTVStageTestVerifyIngest|Verify that all pre-ingest files have been successfully ingested in the DOMS.]] || || ||
|| '''Step''' || '''Test succeeded (yes/no)''' || '''If no, what went wrong?''' ||
|| [[RadioTVStageTestStartTomcat|Start tomcat - is the DOMS running?]] || yes (2011-01-31) || ||
|| [[RadioTVStageTestStartIngester|Start the ingester - does it run properly?]]|| yes (2011-01-31) || ||
|| [[BulkIngestBartFiles|Bulk ingest BART files]] || yes (2011-01-31) ||
|| [[RadioTVStageTestStartPreingester|Start the pre-ingester - does it run properly?]] || yes (2011-02-03) || (only drhd 2009 had no files, as the channel didn't exist in march 2009) ||
|| [[RadioTVStageTestVerifyIngest|Were pre-ingest files successfully ingested?]] || yes (2011-02-03) || ||
|| [[RadioTVStageTestVerifyClipping|Can we clip a media file out from an ingested object?]]|| yes (2011-01-25, 2011-02-03) || (note: this test doesn't test that the cutout is the correct, just that it cuts) ||
|| [[RadioTVStageTestVerifySearch|Can the ingested objects be searched and played in a browser?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestTestTimedOutTicket|Is the ticket system able to time out tickets?]] || yes... (2011-02-04) for doms, not domslive.. || For radio: difficult to hear the {{{rck.flv}}} file : ) ||
|| [[RadioTVStageTestTestInvalidTicket|Will invalid tickets prevent a user from streaming video?]] || All things point to yes|| It is hard to forge the tickets. All attempts with forged tickets have failed to play ||
|| [[RadioTVStageTestSecuritySystem|Will a wrong IP be prevented to watch the videos?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestWowzaBackdoor| Test that video playback is not possible, if the doms plugin is not on the classpath ]] || to be tested.. || ||
Line 12: Line 20:
''In the explanations of the tests below, "Run the needed scripts" will be performed by maintenance in STAGE, whereas "Inspect the results" will be performed by DOMS / DigiTV / Summa people.'' [[HowToCountPublishedRadioTVProgramObjectsInFedora|How to count published radioTV program objects in Fedora]]
Line 15: Line 23:
<<Anchor(startTomcat)>>
== Start tomcat - is the DOMS running? ==
=== Run the needed scripts ===
 * Make sure the DOMS Tomcat is up
Line 20: Line 24:
=== Inspect the results ===
''Inspect logs and stuff...''

<<BR>>
<<Anchor(startIngester)>>
== Start the ingester - does it run properly? ==
 * Start the ingester
{{{command-line stuff here...}}}

=== Inspect the results ===
''Inspect logs and that the relevant directories are properly created.''

<<BR>>
<<Anchor(testPreingester)>>
== Does preingester produce proper output files? ==
=== Run the needed scripts ===
In STAGE, on the machine where DigiTV is installed, in directory {{{digitv/bin}}} do the following
{{{
  ./run_preingest.sh <hotfolder> 2010-03-01 2010-03-08 100fm dr1 drhd
  ./run_preingest.sh <hotfolder> 2009-03-01 2009-03-08 100fm dr1 drhd
}}}
where {{{<hotfolder>}}} is the folder which the ingester reads from.
=== Inspect the results ===
 1. Check that files have been created in the hotfolder for the given dates and channels.
 1. For one xml-file for {{{100fm}}}, make a random check that it contains data inside CDATA tags as the title tag shown below, and that it has atleast one file-tag at the end, containing a file-url and a file-name. {{{
 <pbcoreTitle>
                <title><![CDATA[<Something in here !!!!>]]></title>
                <titleType><![CDATA[titel]]></titleType>
 </pbcoreTitle>
}}}
 1. As done for {{{100fm}}}, do the same for {{{dr1}}} and {{{drhd}}}.
Machines used:
|| '''Unit''' || '''Test-machine''' || '''Stage-machine''' || '''Prod-machine''' ||
|| DOMS (testbed) || {{{alhena}}}, user {{{fedora}}} || {{{carme}}}, user {{{develro}}}, real user {{{doms}}} || {{{naiad}}} ||
|| DOMS Ingester || || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| DigiTV (DOMS Preingester) || {{{digitv-test-acs}}}, user {{{fedora}}} || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| IP Role-mapper || || {{{hyperion}}} ({{{http://samling.statsbiblioteket.dk/iprolemapper}}}) || {{{hyperion}}} ({{{http://samling.statsbiblioteket.dk/iprolemapper}}}) ||
|| Summa (backend) || || {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} || {{{summarise01}}} + {{{summarise02}}} (load-balancing) ||
|| Wowza with plugins || {{{iapetus}}}, user {{{larm}}} || {{{adrasthea}}}, user {{{develro}}}, real user {{{wowza}}} || {{{thalassa}}} ||
|| Broadcast Extraction Service (BES) || {{{iapetus}}}, user {{{doms}}} || {{{adrasthea}}} port {{{9361}}}, user {{{develro}}}, real user {{{bess}}} || {{{phoebe}}} ||
|| Web frontend (Radio/TV DOMS Portal) || || {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} || {{{hyperion}}} ({{{http://hyperion:9381/kultur/}}}) ||
|| Transcoder buffer || || local || {{{halley}}} ||
|| (Low-level Bitstorage) || || {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} || ({{{pluto}}}, {{{plutre}}} and {{{plufire}}}) ||
Line 53: Line 38:
<<BR>>
<<Anchor(verifyIngest)>>
== Have all pre-ingest files been successfully ingested in DOMS? ==

=== Inspect the results ===

 * Check the ''lukewarm'' folder.
 * Count the number of files in the ''coldfolder'' and compare it to the number of objects in the DOMS

<<BR>>
<<Anchor(testX)>>
== Test X: ...? ==
=== Run the needed scripts ===
=== Inspect the results ===
''..describe test..''
##The machines used for stage-testing are the folowing:
## * {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} - used for lowlevelbitstorage
## * {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} - used for digitv and ingester
## * {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} - used for the DOMS-portal aka web frontend
## * {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} - used for doms/summa backend (perhaps frontend as well?)
## * {{{carme}}}, user {{{develro}}}, real user {{{doms}}} - used for the doms testbed
## * {{{adrasthea}}}, user {{{develro}}}, real user {{{bess}}} and {{{wowza}}} - used for BES (port {{{9361}}}) and Wowza
##
##The machines used for internal DOMS test are:
## * {{{alhena}}}, user {{{fedora}}} - DOMS test machine
## * {{{iapetus}}}, user {{{doms}}} or {{{larm}}} - used for tests of BES and Wowza
## * {{{digitv-test-acs}}}, user {{{fedora}}} - used for testing DigiTV

STAGE-Test of DOMS RadioTV System

High-level overview of tests in STAGE:

Step

Test succeeded (yes/no)

If no, what went wrong?

Start tomcat - is the DOMS running?

yes (2011-01-31)

Start the ingester - does it run properly?

yes (2011-01-31)

Bulk ingest BART files

yes (2011-01-31)

Start the pre-ingester - does it run properly?

yes (2011-02-03)

(only drhd 2009 had no files, as the channel didn't exist in march 2009)

Were pre-ingest files successfully ingested?

yes (2011-02-03)

Can we clip a media file out from an ingested object?

yes (2011-01-25, 2011-02-03)

(note: this test doesn't test that the cutout is the correct, just that it cuts)

Can the ingested objects be searched and played in a browser?

yes (2011-02-04)

Is the ticket system able to time out tickets?

yes... (2011-02-04) for doms, not domslive..

For radio: difficult to hear the rck.flv file : )

Will invalid tickets prevent a user from streaming video?

All things point to yes

It is hard to forge the tickets. All attempts with forged tickets have failed to play

Will a wrong IP be prevented to watch the videos?

yes (2011-02-04)

Test that video playback is not possible, if the doms plugin is not on the classpath

to be tested..

How to count published radioTV program objects in Fedora


Machines used:

Unit

Test-machine

Stage-machine

Prod-machine

DOMS (testbed)

alhena, user fedora

carme, user develro, real user doms

naiad

DOMS Ingester

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

DigiTV (DOMS Preingester)

digitv-test-acs, user fedora

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

IP Role-mapper

hyperion (http://samling.statsbiblioteket.dk/iprolemapper)

hyperion (http://samling.statsbiblioteket.dk/iprolemapper)

Summa (backend)

debit, user develro, real user summahst

summarise01 + summarise02 (load-balancing)

Wowza with plugins

iapetus, user larm

adrasthea, user develro, real user wowza

thalassa

Broadcast Extraction Service (BES)

iapetus, user doms

adrasthea port 9361, user develro, real user bess

phoebe

Web frontend (Radio/TV DOMS Portal)

stage05 aka epimetheus, user develro

hyperion (http://hyperion:9381/kultur/)

Transcoder buffer

local

halley

(Low-level Bitstorage)

stage01 aka tethys, user doms

(pluto, plutre and plufire)

Stage-Test of DOMS RadioTV System (last edited 2011-02-11 10:33:15 by jrg)