Differences between revisions 24 and 94 (spanning 70 versions)
Revision 24 as of 2011-01-19 14:39:14
Size: 1104
Editor: jrg
Comment:
Revision 94 as of 2011-02-11 10:33:15
Size: 5380
Editor: jrg
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
''In the explanations of the tests below, "Run the needed scripts" will be performed by maintenance in STAGE, whereas "Inspect the results" will be performed by DOMS / DigiTV / Summa people.'' || '''Step''' || '''Test succeeded (yes/no)''' || '''If no, what went wrong?''' ||
|| [[RadioTVStageTestStartTomcat|Start tomcat - is the DOMS running?]] || yes (2011-01-31) || ||
|| [[RadioTVStageTestStartIngester|Start the ingester - does it run properly?]]|| yes (2011-01-31) || ||
|| [[BulkIngestBartFiles|Bulk ingest BART files]] || yes (2011-01-31) ||
|| [[RadioTVStageTestStartPreingester|Start the pre-ingester - does it run properly?]] || yes (2011-02-03) || (only drhd 2009 had no files, as the channel didn't exist in march 2009) ||
|| [[RadioTVStageTestVerifyIngest|Were pre-ingest files successfully ingested?]] || yes (2011-02-03) || ||
|| [[RadioTVStageTestVerifyClipping|Can we clip a media file out from an ingested object?]]|| yes (2011-01-25, 2011-02-03) || (note: this test doesn't test that the cutout is the correct, just that it cuts) ||
|| [[RadioTVStageTestVerifySearch|Can the ingested objects be searched and played in a browser?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestTestTimedOutTicket|Is the ticket system able to time out tickets?]] || yes... (2011-02-04) for doms, not domslive.. || For radio: difficult to hear the {{{rck.flv}}} file : ) ||
|| [[RadioTVStageTestTestInvalidTicket|Will invalid tickets prevent a user from streaming video?]] || All things point to yes|| It is hard to forge the tickets. All attempts with forged tickets have failed to play ||
|| [[RadioTVStageTestSecuritySystem|Will a wrong IP be prevented to watch the videos?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestWowzaBackdoor| Test that video playback is not possible, if the doms plugin is not on the classpath ]] || to be tested.. || ||
Line 7: Line 18:
|| '''Step''' || '''Test succeeded (yes/no)''' || '''If no, what went wrong?''' ||
|| [[RadioTVStageTestStartTomcat|Start tomcat - is the DOMS running?]] || yes || ||
|| [[RadioTVStageTestStartIngester|Start the ingester - does it run properly?]]|| to be tested.. || ||
|| [[RadioTVStageTestStartPreingester|Start the pre-ingester - does it run properly?]] || to be tested.. || ||
|| [[RadioTVStageTestVerifyIngest|Verify that all pre-ingest files have been successfully ingested in the DOMS.]] || to be tested.. || ||
Line 17: Line 23:
<<Anchor(testX)>>
== Test X: ...? ==
=== Run the needed scripts ===
=== Inspect the results ===
''..describe test..''

Machines used:
|| '''Unit''' || '''Test-machine''' || '''Stage-machine''' || '''Prod-machine''' ||
|| DOMS (testbed) || {{{alhena}}}, user {{{fedora}}} || {{{carme}}}, user {{{develro}}}, real user {{{doms}}} || {{{naiad:7880}}} ||
|| DOMS Ingester || || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| DigiTV (DOMS Preingester) || {{{digitv-test-acs}}}, user {{{fedora}}} || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| IP Role-mapper || || {{{hyperion}}} ({{{http://samling.statsbiblioteket.dk/iprolemapper}}}) || {{{hyperion}}} ({{{http://samling.statsbiblioteket.dk/iprolemapper}}}) ||
|| Summa (backend) || || {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} || {{{summarise01}}} + {{{summarise02}}} (load-balancing) ||
|| Wowza with plugins || {{{iapetus}}}, user {{{larm}}} || {{{adrasthea}}}, user {{{develro}}}, real user {{{wowza}}} || {{{thalassa}}} ||
|| Broadcast Extraction Service (BES) || {{{iapetus}}}, user {{{doms}}} || {{{adrasthea}}} port {{{9361}}}, user {{{develro}}}, real user {{{bess}}} || {{{phoebe}}} ||
|| Web frontend (Radio/TV DOMS Portal) || || {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} || {{{hyperion}}} ({{{http://hyperion:9381/kultur/}}}) ||
|| Transcoder buffer || || local || {{{halley}}} ||
|| (Low-level Bitstorage) || || {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} || ({{{pluto}}}, {{{plutre}}} and {{{plufire}}}) ||


##The machines used for stage-testing are the folowing:
## * {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} - used for lowlevelbitstorage
## * {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} - used for digitv and ingester
## * {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} - used for the DOMS-portal aka web frontend
## * {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} - used for doms/summa backend (perhaps frontend as well?)
## * {{{carme}}}, user {{{develro}}}, real user {{{doms}}} - used for the doms testbed
## * {{{adrasthea}}}, user {{{develro}}}, real user {{{bess}}} and {{{wowza}}} - used for BES (port {{{9361}}}) and Wowza
##
##The machines used for internal DOMS test are:
## * {{{alhena}}}, user {{{fedora}}} - DOMS test machine
## * {{{iapetus}}}, user {{{doms}}} or {{{larm}}} - used for tests of BES and Wowza
## * {{{digitv-test-acs}}}, user {{{fedora}}} - used for testing DigiTV

STAGE-Test of DOMS RadioTV System

High-level overview of tests in STAGE:

Step

Test succeeded (yes/no)

If no, what went wrong?

Start tomcat - is the DOMS running?

yes (2011-01-31)

Start the ingester - does it run properly?

yes (2011-01-31)

Bulk ingest BART files

yes (2011-01-31)

Start the pre-ingester - does it run properly?

yes (2011-02-03)

(only drhd 2009 had no files, as the channel didn't exist in march 2009)

Were pre-ingest files successfully ingested?

yes (2011-02-03)

Can we clip a media file out from an ingested object?

yes (2011-01-25, 2011-02-03)

(note: this test doesn't test that the cutout is the correct, just that it cuts)

Can the ingested objects be searched and played in a browser?

yes (2011-02-04)

Is the ticket system able to time out tickets?

yes... (2011-02-04) for doms, not domslive..

For radio: difficult to hear the rck.flv file : )

Will invalid tickets prevent a user from streaming video?

All things point to yes

It is hard to forge the tickets. All attempts with forged tickets have failed to play

Will a wrong IP be prevented to watch the videos?

yes (2011-02-04)

Test that video playback is not possible, if the doms plugin is not on the classpath

to be tested..

How to count published radioTV program objects in Fedora


Machines used:

Unit

Test-machine

Stage-machine

Prod-machine

DOMS (testbed)

alhena, user fedora

carme, user develro, real user doms

naiad:7880

DOMS Ingester

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

DigiTV (DOMS Preingester)

digitv-test-acs, user fedora

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

IP Role-mapper

hyperion (http://samling.statsbiblioteket.dk/iprolemapper)

hyperion (http://samling.statsbiblioteket.dk/iprolemapper)

Summa (backend)

debit, user develro, real user summahst

summarise01 + summarise02 (load-balancing)

Wowza with plugins

iapetus, user larm

adrasthea, user develro, real user wowza

thalassa

Broadcast Extraction Service (BES)

iapetus, user doms

adrasthea port 9361, user develro, real user bess

phoebe

Web frontend (Radio/TV DOMS Portal)

stage05 aka epimetheus, user develro

hyperion (http://hyperion:9381/kultur/)

Transcoder buffer

local

halley

(Low-level Bitstorage)

stage01 aka tethys, user doms

(pluto, plutre and plufire)

Stage-Test of DOMS RadioTV System (last edited 2011-02-11 10:33:15 by jrg)