Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

November 2021 PREPRODUCTION (Version

5

6) vs November 2021

PREPRODUCTION

PRODUCTION (Version

6

1) traceability

Readme 3559 records refreshed with new UUID's as expected, due to final number of January 2021 concept changes after last minute vaccines changes and other fixes

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
.JSON filen/aRemoved the Member Release warning, as this is the final production releaseRefsetDescriptor files9

9 new records had their UUID's refreshed, as expected

SimpleMap files3559

Not populating the Language Refset fields as expected!

However, as it looks like this has been broken for a few cycles now, I'm opening up a ticket to fix it urgently (

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyISRS-1172
) but will not hold up the release for this, as it's still only a soft launch release and so metadata is not a critical failure.

SimpleMap files548

548 records had their UUID's updated as expected, as this matches exactly the number of records added for CTV3 (900000000000497000) as part of the normal authoring cycle updates, exported from the termServer 

Readme filen/a
All x prefixes removed, and Package naming convention updated to Production, as expected.


October 2021 PRODUCTION (PUBLISHED) to November 2021 PREPRODUCTION (Version 6) traceability

SUMMARY COMPONENT REPORT:  https://docs.google.com/spreadsheets/d/1WPmrSuS3cXNN3OLkYe8NW0vp9lUGmb4opP2Tcyshw3w/edit#gid=0

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
RefsetDescriptor files

9 records added for new expression refsets as expected - see email from Linda + Kai at 02:37 on  

> 0aee0539-4dab-4ece-ba63-df08a347fb2c 20210131 1 900000000000012004 900000000000456007 1119417006 449608002 1119460002 0
> 1d472f20-d375-4b15-bccb-fff42ae145ce 20210131 1 900000000000012004 900000000000456007 1119468009 449608002 1119460002 0
> 29d8e58d-ed48-46f9-ad3f-ba1f4f01302e 20210131 1 900000000000012004 900000000000456007 1119468009 1119454002 1119437005 1
> 673ec076-149d-4df0-9bb0-9faac6479377 20210131 1 900000000000012004 900000000000456007 1119435002 1119436001 1119437005 1
> 74023db2-c222-475f-a97f-3a98250e5d04 20210131 1 900000000000012004 900000000000456007 1119417006 1119456000 1119461003 2
> 8f6aa174-31a6-471f-af95-1418194ed6e0 20210131 1 900000000000012004 900000000000456007 1119435002 733616009 1119461003 2
> c5e6e15c-97c5-4a74-ac82-a432590e3cb7 20210131 1 900000000000012004 900000000000456007 1119468009 1119457009 1119461003 2
> f09f2c8a-2007-4226-9df6-e5fcb20edb1e 20210131 1 900000000000012004 900000000000456007 1119417006 1119454002 1119437005 1
> f61db339-44bd-498b-90ca-a2c47b2a4b16 20210131 1 900000000000012004 900000000000456007 1119435002 449608002 1119460002 0



0 changes as expected

Concept files909

151

Lateralizable Refset (Simple refset) files169 

152 new records

plus 17 inactivated records

As expected as matches Yong's intentions, which he sent in email at 16:29 on  ...

Which again matches the 169 records in the Delta file downloaded from the Refset Tool...

Concept files89581901

records updated, plus

3512

210 records inactivated, plus

3545

548 records added,

...as expected as the

added (3545) + inactivated (3512) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

...plus the updated total (1901) matches exactly with the total records in the Concepts Changed report (5413): https://docs.google.com/spreadsheets/d/1QhxK1cja523C8CADBK75wzJ4qeXgIKSOfxgSPCR6E8g/edit#gid=0

MINUS the total number of inactivations (3512) - therefore 5413-3512 = 1901

totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Description files
24523
2874
8004

98 records updated, plus

3568

495 records inactivated, plus

12951

2281 records added

...as expected as the

added (12951) + inactivated (3568) + updated (8004)

totals ALMOST match exactly

with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

with Summary Component Stats report (linked above)

****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 3000 Descriptions themselves!   Therefore MY TOTALS are definitely wrong!  We therefore have to trust the reports from now on..

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Relationship files
94725
10892
3402

356 records updated, plus

40147

3681 records inactivated, plus

51176

6855 records added

...as expected as the

added (51176) + inactivated (40147) the updated (3402) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

OwlExpression
Relationship Concrete Values files
20050
43
12476

0 records updated, plus

3568

1 records inactivated, plus

4006

42 records added

...as expected as

the added (4006) + inactivated (3568) the updated (12476) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

the totals match exactly with the Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 07:31 + 17:24 on  + )

OwlExpression files2923

2281 records updated, plus

212 records inactivated, plus

430 records added

...as expected as the totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Stated Relationship files0

0 records updated, plus

0 records inactivated, plus

0 records added

As expected due to full migration to OWLExpression file in the last July 2019 International Edition

TextDefinition files
771
104

0 records updated, plus

100

9 records inactivated, plus

671

95 records added

...as expected as the

added (671) + inactivated (100) + updated (0)

totals ALMOST match exactly

with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

with Summary Component Stats report (linked above)

****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 20 Text Definitions themselves!   Therefore MY TOTALS are definitely wrong!  We therefore have to trust the reports from now on..

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

SimpleMap files
3547
568

0 records updated, plus

0

4 records inactivated for ICD-0 (446608001)

3547

, as expected, matching the 4 inactivation records in the Delta from mapping tool + the figures in the icd0stats.txt file from WCI.

564 records added, as expected as:

3545
  • 548 added for CTV3 (900000000000497000) as part of the normal authoring cycle updates, exported from the termServer - this is the exact expected amount as it matches exactly the number of new concepts created in the latest authoring cycle
  • +
 2
  • 16 new/updated records for ICD-0 (446608001) as expected, matching the
2
  • 16 active records in the Delta from mapping tool + the figures in the icd0stats.txt file from WCI.
ExtendedMap files
5474
529
9

0 records updated, plus

3276

98 records inactivated, plus

2189

431 records added,

as expected from

the 2189

the 431 additions +

 3276

 98 inactivations +

9

0 updates in the ICD-10 map (449080006) Delta file that WCI sent us from the mapping tool export + NOT the figures in the icd10stats.txt file from WCI (WHICH CANNOT CURRENTLY BE USED FOR VALIDATION PURPOSES DUE TO THE EXTENDED MAP ALLOWING MULTIPLE MAP RECORDS PER CONCEPT, AND US ONLY BEING ABLE OT VALIDATE NUMBER OF MAP RECORDS (not number of concepts) ADDED/INACTIVATED IN THIS CYCLE - HAVE ASKED RICK HOW EASY IT'D BE TO UPDATE THE REPORT TO INCLUDE THESE STATS INSTEAD OF/AS WELL AS THE CURRENT Concept level STATS....

Simple Refset files
169
84

0 records updated, plus

17

30 records inactivated, plus

152

54 records added, as expected from the Lateralizable Refset changes (723264001) that Yong made in this cycle, exported in a Delta file from the Refset tool

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

SENT LATERALIZABLE CHANGES TO PETER + YONG ON 18/11 FOR REVIEW in 

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyFRI-317

Yong finally signed off content on 23/11/2021 in the FRI-317 ticket:

"Hi Andrew Atkinson, I have run my scripts and the results are the same (30 inactivations and 54 new records).  Cheers, Yong" 

Yong to run his local scripts to cross check 2x final times (December + January) to ensure still matching and no more edge cases - if so we can finally move to the new automated solution with no manual cross checks required

ModuleDependency files

3


3 records updated, as expected for

January

November 2021 effectiveTimes

Readme file
January


November 2021 dates updated + Beta "x" prefixes added, as expected

MRCM AttributeDomain
Association Reference files
2
850

2 new records added:

> 02f30651-d535-40d1-83be-3e73bacb0c20 20210131 1 900000000000012004 723561005 320081000221109 373873005 0 0..1 0..0 723597001 723596005
> 5c0fcb70-c87f-4058-9ee5-02d3756faace 20210131 1 900000000000012004 723561005 320091000221107 373873005 0 0..1 0..0 723597001 723596005

as confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

MRCM AttributeRange files5

2 records added, plus

> 47eced5c-af89-41ec-95a4-cbcb992438c3 20210131 1 900000000000012004 723562003 320081000221109 < 260299005 |Number (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 320081000221109 |Unit of presentation size quantity| = < 260299005 |Number (qualifier value)| 723597001 723596005
> 5c1e3361-3410-460e-87e3-3c8b76e00c39 20210131 1 900000000000012004 723562003 320091000221107 << 767524001 |Unit of measure (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 320091000221107 |Unit of presentation size unit| = << 767524001 |Unit of measure (qualifier value)| 723597001 723596005

3 records updated:

< 3385133c-0886-4c6f-9e6d-2f1d216c9f91 20170731 1 900000000000012004 723562003 370133003 << 105590001 |Substance (substance)| << 123038009 |Specimen (specimen)|: [0..*] { [0..1] 370133003 |Specimen substance| = << 105590001 |Substance (substance)| } 723597001 723596005
> 3385133c-0886-4c6f-9e6d-2f1d216c9f91 20210131 1 900000000000012004 723562003 370133003 << 105590001 |Substance (substance)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| << 123038009 |Specimen (specimen)|: [0..*] { [0..1] 370133003 |Specimen substance| = (<< 105590001 |Substance (substance)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)|) } 723597001 723596005

< adbbf064-83a0-4125-85a5-6409dc352888 20200731 1 900000000000012004 723562003 370130000 << 118598001 |Property of measurement (qualifier value)| (<< 363787002 |Observable entity (observable entity)| OR << 386053000 |Evaluation procedure (procedure)|): [0..1] { [0..1] 370130000 |Property| = << 118598001 |Property of measurement (qualifier value)| } 723597001 723596005
> adbbf064-83a0-4125-85a5-6409dc352888 20210131 1 900000000000012004 723562003 370130000 << 118598001 |Property (qualifier value)| (<< 363787002 |Observable entity (observable entity)| OR << 386053000 |Evaluation procedure (procedure)|): [0..1] { [0..1] 370130000 |Property| = << 118598001 |Property (qualifier value)| } 723597001 723596005

< f58d75aa-599a-42e7-9f35-31a9c8a7d6d9 20200131 1 900000000000012004 723562003 246501002 << 272394005 |Technique (qualifier value)| OR << 273249006 |Assessment scales (assessment scale)| << 363787002 |Observable entity (observable entity)|: [0..*] { [0..1] 246501002 |Technique| = (<< 272394005 |Technique (qualifier value)| OR << 273249006 |Assessment scales (assessment scale)|) } 723597001 723596005
> f58d75aa-599a-42e7-9f35-31a9c8a7d6d9 20210131 1 900000000000012004 723562003 246501002 << 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)| << 363787002 |Observable entity (observable entity)|: [0..*] { [0..1] 246501002 |Technique| = (<< 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)|) } 723597001 723596005


6 records updated, plus

128 records inactivated, plus

716 records added

This includes:

  • 368 changes (22 inactivations, 4 updates + 342 additions) to the SE refset (734138000)
  • 0 changes to the SP refset (734139008)
  • November 2021 SEP changes.txt

SENT SEP CHANGES TO PETER + YONG ON 18/11 FOR REVIEW in 

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyFRI-299

...as expected as the totalsALMOSTmatch exactly with total of all Inactivation Reasons in the "Refsets" tab in the Summary Component Stats report (linked above)


Yong finally signed off content on 23/11/2021 in the FRI-299 ticket:

"HiAndrew Atkinson, I have run my scripts and the changes for the SEP refset and Laterality are covered by the latest Pre-prod version of the November release. So, these refsets are ready for release. Cheers,  Yong"

Yong to run his local scripts to cross check 2x final times (December + January) to ensure still matching and no more edge cases - if so we can finally move to the new automated solution with no manual cross checks required

Attribute Value files1524

30 records updated, plus

82 records inactivated,

1412 records added

..as expected as the totals ALMOST match exactly with total of Description Inactivation Indicators (900000000000490003) + Concept Inactivation Indicators (900000000000489007) in the "Refsets" tab in the Summary Component Stats report (linked above)

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  MRCM Domain files5

5 records updated, plus

0 inactivated, plus

0 new record added

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

Association Reference files12791

2 records updated, plus

4488 records inactivated, plus

8301 records added

...as expected as the added (8301) + inactivated (4488) + updated (2) totals ALMOST match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

Yong confirmed that this is not quite what he expected in email trail at 12:18 on   inactivation for the 734138000|Anatomy structure and entire association reference set (foundation metadata concept)|

Attribute Value files37275

4791 records updated, plus

3186 records inactivated,

29298 records added

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

Language refset files
33475
5891
456

351 records updated, plus

6970

992 records inactivated, plus

26049

4548 records added

...as expected as

the added (26049) + inactivated (6970)

the

updated (456) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

totals match exactly with Summary Component Stats report (linked above)

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  


November 2021 PREPRODUCTION (Version 5) vs November 2021 PREPRODUCTION (Version 6) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
All filesn/a
0 changes as expected