Locked History Actions

Diff for "ImportM6"

Differences between revisions 2 and 4 (spanning 2 versions)
⇤ ← Revision 2 as of 2009-11-02 07:55:19 →
Size: 9150
Editor: NielsBaggesen
Comment:
← Revision 4 as of 2009-11-02 08:26:53 → ⇥
Size: 10814
Editor: NielsBaggesen
Comment:
Deletions are marked like this. Additions are marked like this.
Line 13: Line 13:
Jeg har konverteret data fra Eriks dump med dato 2009-10-23.

Jeg har lagt resultatet i en zip-fil her:

O/dorete/konvertering/total.out.2009-10-28.zip

Logfilen fra kørslen kan også findes i zip-filen. Ligesom de andre gange er der nogle OWN-koder, der ikke kan konverteres.		 Ligesom de andre gange er der nogle OWN-koder, der ikke kan konverteres.
Line 26: Line 20:

Mvh. Mads
Line 57: Line 48:
Line 61: Line 51:
Line 62: Line 53:
Line 64: Line 56:
Eksemplar konvertering:
Line 66: Line 57:
Line 68: Line 58:
Dette dækker over eksemplare tilhørende horizon lokationer, som ikke
skal migreres.		 Dette dækker over eksemplare tilhørende horizon lokationer, som ikke skal migreres.
Line 110: Line 99:
Line 115: Line 103:
Line 117: Line 106:
Lån: 121006 læst, 1 skippet, 27 fejl
Det skippede lån ligger på et materiale, der ikke skal konverteres,
fejlene skyldes primært fejl i eksemplar posterne.

}}}		 Det har ikke været muligt at lave en korrekt konvertering at eksemplare
i hjemkaldelses på grund at manglende læse rettigheder til horizons burb
tabel.

Lån læst:140639
Lån skippet:0
Regulære fejl: 99
42 af disse fejl skyldes at låneren tilknyttet eksemplaret ikke kunne
finde den tilhørende låner i låne tabellen. Resten skyldes
konverteringsfejl på selve eksemplaret.
}}}
Line 123: Line 119:
Line 127: Line 124:
Line 128: Line 126:
Line 130: Line 129:
Bestillinger/reservationer: 13476 læst, 1936 skippet, 0 fejl
Poster skippet er fravalgt ifølge konverterings specifikationen.

}}}		 Reservationer/bestillinger læst: 14367
Reservationer/bestillinger skippet:1992
Disse skyldes primært materialer på vendtehylde, men der er også enkelte bestillinger/reservationer på eksemplare tilhørende horizon lokationen 'A', der ikke skal konverteres.

Regulære fejl: 0

}}}
Line 135: Line 138:
{{{
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000008
0212 : Z37-END-REQUEST-DATE should be latest then Z37-REQUEST-DATE
%Errors found for record in line 000005201
}}}
{{{
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000043
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000044
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000058
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000061
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000062
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000070
}}}
Line 142: Line 155:
Line 145: Line 159:
%Errors found for record in line 000000132 %Errors found for record in line 000000126
0209 : Wrong Borrower ID (Z16-ID)
%Errors found for record in line 000000127
Line 147: Line 164:
%Errors found for record in line 000000660 %Errors found for record in line 000000611

0208 : conflict between Z16-SUB-LIBRARY and Z16-ITEM-STATUS (check tab15)
0209 : Wrong Borrower ID (Z16-ID)
%Errors found for record in line 000163686
Line 149: Line 170:
%Errors found for record in line 000165166
}}}		 %Errors found for record in line 000163794
0207 : Z16-CLAIM-2 (-3, -4) can not be empty when Z16-CLAIM is "Y"
%Errors found for record in line 000163877
}}}
Line 152: Line 176:
{{{
0110 : Z30-MATERIAL is not valid
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000093720

}}}
{{{
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129850
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129851
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129852
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129853

0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000048
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000053
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000088
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000089
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000090
}}}
Line 159: Line 200:

Import af poster til M6

Lige som ved M5 er alle importer kørt med p_file_06 der checker data (i et vist omfang).

Køretiden var ca. 10 timer.

For de meget interesserede kan alle data- og logfiler ses [http://rastaban:30080/milestone/m6/ her]

Bibliografiske poster

Fra Mads kom der følgende kommentar da han afleverede data: 

Ligesom de andre gange er der nogle OWN-koder, der ikke kan konverteres.

Derudover er der en enkelt fejl pga. sorteringstegn fra Horizon. Den fejl skal løses i dumpet fra Horizon. Denne gang har jeg fået logget id'erne med, så det skulle være til at finde de pågældende poster.

Der er også dukket en ny fejl op i post 3543359: 'AnselToUnicode problem'. Forhåbentlig har Erik eller Bjørn et bud på hvad der driller der.

Det drejer sig nu om 7 poster, der ikke bliver konverteret over.

Da jeg kikkede loggen igennem noterede jeg mig 

Der er ca 20 linjer omhandlende delfelt 5 problemer:
2009-10-30 11:07:31,000 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Kalø for record: 783700. Using empty string as subfield 5.
2009-10-30 11:07:31,000 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Kalø for record: 783700. Using value of subfield 5 as subfield 6.
2009-10-30 11:20:59,441 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error converting OWN code for record: 2595975 --- Error looking up subfield 5 value: DUBLETTER KASSERES VED PÅPLADSLÆGNING. Returning OWN code UFEJL.
2009-10-30 11:20:59,442 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Dubletter kasseres ved påpladslægning for record: 2595975. Using empty string as subfield 5.
2009-10-30 11:20:59,442 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Dubletter kasseres ved påpladslægning for record: 2595975. Using value of subfield 5 as subfield 6.
2009-10-30 11:23:13,535 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Puskin Aleksander for record: 2929532. Using empty string as subfield 5.
2009-10-30 11:23:13,536 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Puskin Aleksander for record: 2929532. Using value of subfield 5 as subfield 6.
2009-10-30 11:23:14,372 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Bulgakov Michail for record: 2932047. Using empty string as subfield 5.
2009-10-30 11:23:14,372 [main] WARN  dk.statsbiblioteket.alephimportexport.marc.HOLConvert - Error looking up subfield 5 value: Bulgakov Michail for record: 2932047. Using value of subfield 5 as subfield 6.

Dertil er der nogle Horizon/Aleph tegnsætsproblemer, eksemplificeret ved:

2009-10-30 11:25:38,771 [main] ERROR dk.statsbiblioteket.alephimportexport.marc.MARCConvert - unable to write horizon record in aleph format: 
Caused by: dk.statsbiblioteket.marcrecord.MARCRecordException: Unmatch Horizon sorting field terminator found

2009-10-30 11:28:22,655 [main] ERROR dk.statsbiblioteket.alephimportexport.marc.MARCConvert - unable to write horizon record in aleph format: 
Caused by: dk.statsbiblioteket.marcrecord.MARCRecordException: Aleph escape code found in field: 530 subfield: a

2009-10-30 11:28:24,187 [main] ERROR dk.statsbiblioteket.alephimportexport.marc.MARCConvert - unable to write horizon record in aleph format: 
Caused by: dk.statsbiblioteket.marcrecord.MARCRecordException: AnselToUnicode problem

2009-10-30 11:28:24,584 [main] ERROR dk.statsbiblioteket.alephimportexport.marc.MARCConvert - unable to write horizon record in aleph format: 
Caused by: dk.statsbiblioteket.marcrecord.MARCRecordException: Nested sorting fields found

Der var ikke nogen yderligere kommentarer i logfilerne fra Aleph.

Eksemplarposterne

Bjørn havde følgende bemærkninger til posterne: 

Eksemplare læst:3409018
Eksemplare skippet: 58034
Dette dækker over eksemplare tilhørende horizon lokationer, som ikke skal migreres.

Regulære fejl: 14517
Dette ganske store tal skyldes primært eksemplare, tilhørende 
hospitaler, der er slettet fra horizon basen men ikke i milepæls 
versionen af samme. Der er desuden et betydeligt antal indgange for 
tidskrifterseksemplare uden tilhørende subscriptioner.

Der er desuden en hel del warnings på grund af horizon shelving notes, 
der er for lange til at kunne være i alephs call number 2 felt.

Ser vi bort fra hospitalerne er der fejl såsom 

2009-10-28 14:04:05,373 [main] WARN  migrateToAleph - Hz item# 245534 (Loc: Slavisk, 3587147334) unable to translate itype: p to material type  for m
2009-10-28 14:04:05,373 [main] WARN  migrateToAleph - Hz item# 245534 (Loc: Slavisk, 3587147334) unable to translate itype: p to item status for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884616 (Loc: Slavisk, 3587147342) unable to translate itype: p to material type  for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884616 (Loc: Slavisk, 3587147342) unable to translate itype: p to item status for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884619 (Loc: Slavisk, 3587147350) unable to translate itype: p to material type  for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884619 (Loc: Slavisk, 3587147350) unable to translate itype: p to item status for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884621 (Loc: Slavisk, 3587147369) unable to translate itype: p to material type  for m
2009-10-28 14:04:05,374 [main] WARN  migrateToAleph - Hz item# 2884621 (Loc: Slavisk, 3587147369) unable to translate itype: p to item status for m

2009-10-28 14:04:15,185 [main] ERROR dk.statsbiblioteket.alephimportexport.oracle.AlephImportRecord - z30:000009982/000010 value of 'callNo2' too big 83/80/80: Studie Archeologického ústavu _Ceskoslovenské akademie v_ed v Brn_e ; ro_cnik 9,
2009-10-28 14:04:15,186 [main] ERROR dk.statsbiblioteket.alephimportexport.oracle.AlephImportRecord - z30:000009983/000010 value of 'callNo2' too big 83/80/80: Studie Archeologického ústavu _Ceskoslovenské akademie v_ed v Brn_e ; ro_cnik 8,
2009-10-28 14:04:15,186 [main] ERROR dk.statsbiblioteket.alephimportexport.oracle.AlephImportRecord - z30:000009984/000010 value of 'callNo2' too big 83/80/80: Studie Archeologického ústavu _Ceskoslovenské akademie v_ed v Brn_e ; ro_cnik 8,

Importen til Aleph gav anledning til en del fejl af følgende typer: 

0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000060
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000309
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000376
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000380

0206 : Z30-COLLECTION is not valid
%Errors found for record in line 000001566

I alt er der ca 230.000 poster med fejl!

Lån

Bjørn gav følgende kommentar med: 

Det har ikke været muligt at lave en korrekt konvertering at eksemplare 
i hjemkaldelses på grund at manglende læse rettigheder til horizons burb 
tabel.

Lån læst:140639
Lån skippet:0
Regulære fejl: 99
42 af disse fejl skyldes at låneren tilknyttet eksemplaret ikke kunne 
finde den tilhørende låner i låne tabellen. Resten skyldes 
konverteringsfejl på selve eksemplaret.

Der var ingen kommentarer fra Aleph ved importen, udover 

Start check/correct of records...
Program is not exists: correct_z36

Reservationer

Bjørns kommentar: 

Reservationer/bestillinger læst: 14367
Reservationer/bestillinger skippet:1992
Disse skyldes primært materialer på vendtehylde, men der er også enkelte bestillinger/reservationer på eksemplare tilhørende horizon lokationen 'A', der ikke skal konverteres.

Regulære fejl: 0

Importen til Aleph gav et antal kommentarer af typen 

0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000043
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000044
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000058
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000061
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000062
0202 : Z37-PICKUP-LOCATION is not valid
%Errors found for record in line 000000070

Copy-poster med tilhørende items

Aleph importen af subscriptions gav en del fejl såsom 

0209 : Wrong Borrower ID (Z16-ID)
%Errors found for record in line 000000126
0209 : Wrong Borrower ID (Z16-ID)
%Errors found for record in line 000000127

0208 : conflict between Z16-SUB-LIBRARY and Z16-ITEM-STATUS (check tab15)
%Errors found for record in line 000000611

0208 : conflict between Z16-SUB-LIBRARY and Z16-ITEM-STATUS (check tab15)
0209 : Wrong Borrower ID (Z16-ID)
%Errors found for record in line 000163686
0207 : Z16-CLAIM-2 (-3, -4) can not be empty when Z16-CLAIM  is "Y"
%Errors found for record in line 000163794
0207 : Z16-CLAIM-2 (-3, -4) can not be empty when Z16-CLAIM  is "Y"
%Errors found for record in line 000163877

De tilhørende copyissue og copyitem poster gav følgende typer af fejl: 

0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129850
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129851
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129852
0208 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-STATUS
%Errors found for record in line 000129853

0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000048
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000053
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000088
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000089
0207 : conflict between Z30-SUB-LIBRARY and Z30-ITEM-PROCESS-STATUS
%Errors found for record in line 000000090

Vendor poster

Importen ef vendor (SOL50 z70 og z72) poster gav ingen klager.

last edited 2010-02-23 14:38:17 by localhost