Differences between revisions 9 and 90 (spanning 81 versions)
Revision 9 as of 2011-01-18 14:58:59
Size: 2663
Comment:
Revision 90 as of 2011-02-09 15:38:27
Size: 5132
Editor: jrg
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
|| '''Step''' || '''Answer (yes/no)''' || If no, what went wrong? ||
|| [[#startTomcat|Start tomcat and verify that the DOMS is running]] || || ||
|| [[#startIngester|Start the ingester and verify that it runs properly]]|| || ||
|| [[#testPreingester|Does preingester produce proper output files?]] || to be tested.. || ||
|| [[#verifyIngest|Verify that all pre-ingest files have been successfully ingested into the DOMS]] || || ||
|| '''Step''' || '''Test succeeded (yes/no)''' || '''If no, what went wrong?''' ||
|| [[RadioTVStageTestStartTomcat|Start tomcat - is the DOMS running?]] || yes (2011-01-31) || ||
|| [[RadioTVStageTestStartIngester|Start the ingester - does it run properly?]]|| yes (2011-01-31) || ||
|| [[BulkIngestBartFiles|Bulk ingest BART files]] || yes (2011-01-31) ||
|| [[RadioTVStageTestStartPreingester|Start the pre-ingester - does it run properly?]] || yes (2011-02-03) || (only drhd 2009 had no files, as the channel didn't exist in march 2009) ||
|| [[RadioTVStageTestVerifyIngest|Were pre-ingest files successfully ingested?]] || yes (2011-02-03) || ||
|| [[RadioTVStageTestVerifyClipping|Can we clip a media file out from an ingested object?]]|| yes (2011-01-25, 2011-02-03) || (note: this test doesn't test that the cutout is the correct, just that it cuts) ||
|| [[RadioTVStageTestVerifySearch|Can the ingested objects be searched and played in a browser?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestTestTimedOutTicket|Is the ticket system able to time out tickets?]] || yes... (2011-02-04) for doms, not domslive.. || For radio: difficult to hear the {{{rck.flv}}} file : ) ||
|| [[RadioTVStageTestTestInvalidTicket|Will invalid tickets prevent a user from streaming video?]] || All things point to yes|| It is hard to forge the tickets. All attempts with forged tickets have failed to play ||
|| [[RadioTVStageTestSecuritySystem|Will a wrong IP be prevented to watch the videos?]] || yes (2011-02-04) || ||
|| [[RadioTVStageTestWowzaBackdoor| Test that video playback is not possible, if the doms plugin is not on the classpath ]] || to be tested.. || ||
Line 12: Line 20:
''In the explanations of the tests below, "Run the needed scripts" will be performed by maintenance in STAGE, whereas "Inspect the results" will be performed by DOMS / DigiTV / Summa people.'' [[HowToCountPublishedRadioTVProgramObjectsInFedora|How to count published radioTV program objects in Fedora]]
Line 14: Line 22:
<<Anchor(startTomcat)>>
== Start tomcat and verify that the DOMS is running ==
=== Run the needed scripts ===
 * Make sure the DOMS Tomcat is up
<<BR>>
Line 19: Line 24:
=== Inspect the results ===
''Inspect logs and stuff...''

<<Anchor(startIngester)>>
== Start the ingester and verify that it runs properly ==
 * Start the ingester
{{{command-line stuff here...}}}

=== Inspect the results ===
''Inspect logs and that the relevant directories are properly created.''

<<Anchor(testPreingester)>>
== Does preingester produce proper output files? ==
=== Run the needed scripts ===
In STAGE, on the machine where DigiTV is installed, in directory {{{digitv/bin}}} do the following
{{{
  ./run_preingest.sh <hotfolder> 2010-03-01 2010-03-08 100fm dr1 drhd
  ./run_preingest.sh <hotfolder> 2009-03-01 2009-03-08 100fm dr1 drhd
}}}
where {{{<hotfolder>}}} is the folder which the ingester reads from.
=== Inspect the results ===
 1. Check that files have been created in the hotfolder for the given dates and channels.
 1. For one xml-file for {{{100fm}}}, make a random check that it contains data inside CDATA tags as the title tag shown below, and that it has atleast one file-tag at the end, containing a file-url and a file-name. {{{
 <pbcoreTitle>
                <title><![CDATA[<Something in here !!!!>]]></title>
                <titleType><![CDATA[titel]]></titleType>
 </pbcoreTitle>
}}}
 1. As done for {{{100fm}}}, do the same for {{{dr1}}} and {{{drhd}}}.
Machines used:
|| '''Unit''' || '''Test-machine''' || '''Stage-machine''' || '''Prod-machine''' ||
|| DOMS (testbed) || {{{alhena}}}, user {{{fedora}}} || {{{carme}}}, user {{{develro}}}, real user {{{doms}}} || {{{raiad}}} ||
|| DOMS Ingester || || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| DigiTV (DOMS Preingester) || {{{digitv-test-acs}}}, user {{{fedora}}} || {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} || {{{digitv-prod-acs}}} ||
|| IP Role-mapper || || || ||
|| Summa (backend) || || {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} || ||
|| Wowza with plugins || {{{iapetus}}}, user {{{larm}}} || {{{adrasthea}}}, user {{{develro}}}, real user {{{wowza}}} || {{{thallassa}}} or {{{phoebe}}} ... ||
|| Broadcast Extraction Service (BES) || {{{iapetus}}}, user {{{doms}}} || {{{adrasthea}}} port {{{9361}}}, user {{{develro}}}, real user {{{bess}}} || {{{thallassa}}} or {{{phoebe}}} ... ||
|| Web frontend (Radio/TV DOMS Portal) || || {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} || {{{hyperion}}} ({{{http://hyperion:9381/kultur/}}}) ||
|| Low-level Bitstorage || || {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} || ||
Line 50: Line 37:
<<Anchor(verifyIngest)>>
== Verify that all pre-ingest files have been successfully ingested into the DOMS ==

=== Inspect the results ===

 * Check the ''lukewarm'' folder.
 * Count the number of files in the ''coldfolder'' and compare it to the number of objects in the DOMS

<<Anchor(testX)>>
== Test X: ...? ==
=== Run the needed scripts ===
=== Inspect the results ===
''..describe test..''
##The machines used for stage-testing are the folowing:
## * {{{stage01}}} aka {{{tethys}}}, user {{{doms}}} - used for lowlevelbitstorage
## * {{{stage02}}} aka {{{helene}}}, user {{{develro}}} - real user {{{fedora}}} - used for digitv and ingester
## * {{{stage05}}} aka {{{epimetheus}}}, user {{{develro}}} - used for the DOMS-portal aka web frontend
## * {{{debit}}}, user {{{develro}}}, real user {{{summahst}}} - used for doms/summa backend (perhaps frontend as well?)
## * {{{carme}}}, user {{{develro}}}, real user {{{doms}}} - used for the doms testbed
## * {{{adrasthea}}}, user {{{develro}}}, real user {{{bess}}} and {{{wowza}}} - used for BES (port {{{9361}}}) and Wowza
##
##The machines used for internal DOMS test are:
## * {{{alhena}}}, user {{{fedora}}} - DOMS test machine
## * {{{iapetus}}}, user {{{doms}}} or {{{larm}}} - used for tests of BES and Wowza
## * {{{digitv-test-acs}}}, user {{{fedora}}} - used for testing DigiTV

STAGE-Test of DOMS RadioTV System

High-level overview of tests in STAGE:

Step

Test succeeded (yes/no)

If no, what went wrong?

Start tomcat - is the DOMS running?

yes (2011-01-31)

Start the ingester - does it run properly?

yes (2011-01-31)

Bulk ingest BART files

yes (2011-01-31)

Start the pre-ingester - does it run properly?

yes (2011-02-03)

(only drhd 2009 had no files, as the channel didn't exist in march 2009)

Were pre-ingest files successfully ingested?

yes (2011-02-03)

Can we clip a media file out from an ingested object?

yes (2011-01-25, 2011-02-03)

(note: this test doesn't test that the cutout is the correct, just that it cuts)

Can the ingested objects be searched and played in a browser?

yes (2011-02-04)

Is the ticket system able to time out tickets?

yes... (2011-02-04) for doms, not domslive..

For radio: difficult to hear the rck.flv file : )

Will invalid tickets prevent a user from streaming video?

All things point to yes

It is hard to forge the tickets. All attempts with forged tickets have failed to play

Will a wrong IP be prevented to watch the videos?

yes (2011-02-04)

Test that video playback is not possible, if the doms plugin is not on the classpath

to be tested..

How to count published radioTV program objects in Fedora


Machines used:

Unit

Test-machine

Stage-machine

Prod-machine

DOMS (testbed)

alhena, user fedora

carme, user develro, real user doms

raiad

DOMS Ingester

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

DigiTV (DOMS Preingester)

digitv-test-acs, user fedora

stage02 aka helene, user develro - real user fedora

digitv-prod-acs

IP Role-mapper

Summa (backend)

debit, user develro, real user summahst

Wowza with plugins

iapetus, user larm

adrasthea, user develro, real user wowza

thallassa or phoebe ...

Broadcast Extraction Service (BES)

iapetus, user doms

adrasthea port 9361, user develro, real user bess

thallassa or phoebe ...

Web frontend (Radio/TV DOMS Portal)

stage05 aka epimetheus, user develro

hyperion (http://hyperion:9381/kultur/)

Low-level Bitstorage

stage01 aka tethys, user doms

Stage-Test of DOMS RadioTV System (last edited 2011-02-11 10:33:15 by jrg)