Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

November 2021 PREPRODUCTION (Version

5

6) vs November 2021

PREPRODUCTION

PRODUCTION (Version

6

1) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
.JSON file

Not populating the Language Refset fields as expected!

However, as it looks like this has been broken for a few cycles now, I'm opening up a ticket to fix it urgently (

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyISRS-1172
) but will not hold up the release for this, as it's still only a soft launch release and so metadata is not a critical failure.

SimpleMap files548

548 records had their UUID's updated as expected, as this matches exactly the number of records added for CTV3 (900000000000497000) as part of the normal authoring cycle updates, exported from the termServer 

Readme filen/a
All x prefixes removed, and Package naming convention updated to Production, as expected.All filesn/a0 changes as expected


October 2021 PRODUCTION (PUBLISHED) to November 2021 PREPRODUCTION (Version 6) traceability

SUMMARY COMPONENT REPORT:  https://docs.google.com/spreadsheets/d/1WPmrSuS3cXNN3OLkYe8NW0vp9lUGmb4opP2Tcyshw3w/edit#gid=0

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
RefsetDescriptor files

0 changes as expected

Concept files909

151 records updated, plus

210 records inactivated, plus

548 records added,

...as expected as the

added (3545) + inactivated (3512) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

...plus the updated total (1901) matches exactly with the total records in the Concepts Changed report (5413): https://docs.google.com/spreadsheets/d/1QhxK1cja523C8CADBK75wzJ4qeXgIKSOfxgSPCR6E8g/edit#gid=0

MINUS the total number of inactivations (3512) - therefore 5413-3512 = 1901

totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Description files2874

98 records updated, plus

495 records inactivated, plus

2281 records added

...as expected as the

added (12951) + inactivated (3568) + updated (8004)

totals ALMOST match exactly

with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

with Summary Component Stats report (linked above)

****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 3000 Descriptions themselves!   Therefore MY TOTALS are definitely wrong!  We therefore have to trust the reports from now on..

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Relationship files10892

356 records updated, plus

3681 records inactivated, plus

6855 records added

...as expected as

the added (51176) + inactivated (40147)

the

updated (3402) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Relationship Concrete Values files43

0 records updated, plus

1 records inactivated, plus

42 records added

...as expected as the

added (365) + inactivated (116) the re-activated (0) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/16498MA0R3E3NHwFk4Eo3YLu4ScGOote2s-pcH1p_Lfw/edit#gid=0

totals match exactly with the Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 07:31 + 17:24 on  + )

OwlExpression files2923

2281 records updated, plus

212 records inactivated, plus

430 records added

...as expected as the

added (4006) + inactivated (3568) the updated (12476) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

totals match exactly with Summary Component Stats report (linked above)

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

Stated Relationship files0

0 records updated, plus

0 records inactivated, plus

0 records added

As expected due to full migration to OWLExpression file in the last July 2019 International Edition

TextDefinition files104

0 records updated, plus

9 records inactivated, plus

95 records added

...as expected as the

added (671) + inactivated (100) + updated (0)

totals ALMOST match exactly

with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

with Summary Component Stats report (linked above)

****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 20 Text Definitions themselves!   Therefore MY TOTALS are definitely wrong!  We therefore have to trust the reports from now on..

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

SimpleMap files568

0 records updated, plus

4 records inactivated for ICD-0 (446608001), as expected, matching the 4 inactivation records in the Delta from mapping tool + the figures in the icd0stats.txt file from WCI.

564 records added, as expected as:

3545
  • 548 added for CTV3 (900000000000497000) as part of the normal authoring cycle updates, exported from the termServer - this is the exact expected amount as it matches exactly the number of new concepts created in the latest authoring cycle
  • +
 2
  • 16 new/updated records for ICD-0 (446608001) as expected, matching the
2
  • 16 active records in the Delta from mapping tool + the figures in the icd0stats.txt file from WCI.
ExtendedMap files529

0 records updated, plus

98 records inactivated, plus

431 records added,

as expected from

the 2189

the 431 additions +

 3276

 98 inactivations +

9

0 updates in the ICD-10 map (449080006) Delta file that WCI sent us from the mapping tool export + NOT the figures in the icd10stats.txt file from WCI (WHICH CANNOT CURRENTLY BE USED FOR VALIDATION PURPOSES DUE TO THE EXTENDED MAP ALLOWING MULTIPLE MAP RECORDS PER CONCEPT, AND US ONLY BEING ABLE OT VALIDATE NUMBER OF MAP RECORDS (not number of concepts) ADDED/INACTIVATED IN THIS CYCLE - HAVE ASKED RICK HOW EASY IT'D BE TO UPDATE THE REPORT TO INCLUDE THESE STATS INSTEAD OF/AS WELL AS THE CURRENT Concept level STATS....

Simple Refset files84

0 records updated, plus

30 records inactivated, plus

54 records added, as expected from the Lateralizable Refset changes (723264001) that Yong made in this cycle, exported in a Delta file from the Refset tool

(plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on  )

SENT LATERALIZABLE CHANGES TO PETER + YONG ON 18/11 FOR REVIEW in 

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyFRI-317

Yong finally signed off content on 23/11/2021 in the FRI-317 ticket:

"Hi Andrew Atkinson, I have run my scripts and the results are the same (30 inactivations and 54 new records).  Cheers, Yong" 

Yong to run his local scripts to cross check 2x final times (December + January) to ensure still matching and no more edge cases - if so we can finally move to the new automated solution with no manual cross checks required

ModuleDependency files

3


3 records updated, as expected for November 2021 effectiveTimes

Readme file

November 2021 dates updated + Beta "x" prefixes added, as expected

MRCM AttributeDomain
Association Reference files
2As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  MRCM Domain files5

5 records updated, plus

0 inactivated, plus

0 new record added

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

Association Reference files850

6 records updated, plus

128 records inactivated, plus

716 records added

...as expected as the added (8301) + inactivated (4488) + updated (2) totals ALMOST match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

Yong confirmed that this is not quite what he expected in email trail at 12:18 on   inactivation for the 734138000|Anatomy structure and entire association reference set (foundation metadata concept)|

Attribute Value files1524

30 records updated, plus

82 records inactivated,

1412 records added

850

2 new records added:

> 02f30651-d535-40d1-83be-3e73bacb0c20 20210131 1 900000000000012004 723561005 320081000221109 373873005 0 0..1 0..0 723597001 723596005
> 5c0fcb70-c87f-4058-9ee5-02d3756faace 20210131 1 900000000000012004 723561005 320091000221107 373873005 0 0..1 0..0 723597001 723596005

as confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

MRCM AttributeRange files5

2 records added, plus

> 47eced5c-af89-41ec-95a4-cbcb992438c3 20210131 1 900000000000012004 723562003 320081000221109 < 260299005 |Number (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 320081000221109 |Unit of presentation size quantity| = < 260299005 |Number (qualifier value)| 723597001 723596005
> 5c1e3361-3410-460e-87e3-3c8b76e00c39 20210131 1 900000000000012004 723562003 320091000221107 << 767524001 |Unit of measure (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 320091000221107 |Unit of presentation size unit| = << 767524001 |Unit of measure (qualifier value)| 723597001 723596005

3 records updated:

< 3385133c-0886-4c6f-9e6d-2f1d216c9f91 20170731 1 900000000000012004 723562003 370133003 << 105590001 |Substance (substance)| << 123038009 |Specimen (specimen)|: [0..*] { [0..1] 370133003 |Specimen substance| = << 105590001 |Substance (substance)| } 723597001 723596005
> 3385133c-0886-4c6f-9e6d-2f1d216c9f91 20210131 1 900000000000012004 723562003 370133003 << 105590001 |Substance (substance)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| << 123038009 |Specimen (specimen)|: [0..*] { [0..1] 370133003 |Specimen substance| = (<< 105590001 |Substance (substance)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)|) } 723597001 723596005

< adbbf064-83a0-4125-85a5-6409dc352888 20200731 1 900000000000012004 723562003 370130000 << 118598001 |Property of measurement (qualifier value)| (<< 363787002 |Observable entity (observable entity)| OR << 386053000 |Evaluation procedure (procedure)|): [0..1] { [0..1] 370130000 |Property| = << 118598001 |Property of measurement (qualifier value)| } 723597001 723596005
> adbbf064-83a0-4125-85a5-6409dc352888 20210131 1 900000000000012004 723562003 370130000 << 118598001 |Property (qualifier value)| (<< 363787002 |Observable entity (observable entity)| OR << 386053000 |Evaluation procedure (procedure)|): [0..1] { [0..1] 370130000 |Property| = << 118598001 |Property (qualifier value)| } 723597001 723596005

< f58d75aa-599a-42e7-9f35-31a9c8a7d6d9 20200131 1 900000000000012004 723562003 246501002 << 272394005 |Technique (qualifier value)| OR << 273249006 |Assessment scales (assessment scale)| << 363787002 |Observable entity (observable entity)|: [0..*] { [0..1] 246501002 |Technique| = (<< 272394005 |Technique (qualifier value)| OR << 273249006 |Assessment scales (assessment scale)|) } 723597001 723596005
> f58d75aa-599a-42e7-9f35-31a9c8a7d6d9 20210131 1 900000000000012004 723562003 246501002 << 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)| << 363787002 |Observable entity (observable entity)|: [0..*] { [0..1] 246501002 |Technique| = (<< 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)|) } 723597001 723596005


6 records updated, plus

128 records inactivated, plus

716 records added

This includes:

  • 368 changes (22 inactivations, 4 updates + 342 additions) to the SE refset (734138000)
  • 0 changes to the SP refset (734139008)
  • November 2021 SEP changes.txt

SENT SEP CHANGES TO PETER + YONG ON 18/11 FOR REVIEW in 

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyFRI-299

...as expected as the totalsALMOSTmatch exactly with total of all Inactivation Reasons in the "Refsets" tab in the Summary Component Stats report (linked above)


Yong finally signed off content on 23/11/2021 in the FRI-299 ticket:

"HiAndrew Atkinson, I have run my scripts and the changes for the SEP refset and Laterality are covered by the latest Pre-prod version of the November release. So, these refsets are ready for release. Cheers,  Yong"

Yong to run his local scripts to cross check 2x final times (December + January) to ensure still matching and no more edge cases - if so we can finally move to the new automated solution with no manual cross checks required

Attribute Value files1524

30 records updated, plus

82 records inactivated,

1412 records added

..as expected as the totals ALMOST match exactly with total of Description Inactivation Indicators (900000000000490003) + Concept Inactivation Indicators (900000000000489007) in the "Refsets" tab in the Summary Component Stats report (linked above)

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  

Language refset files5891

351 records updated, plus

992 records inactivated, plus

4548 records added

...as expected as the

added (26049) + inactivated (6970) the updated (456) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0

totals match exactly with Summary Component Stats report (linked above)

As confirmed by Maria/Yong to be as expected in email trail at 12:18 on  


November 2021 PREPRODUCTION (Version 5) vs November 2021 PREPRODUCTION (Version 6) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
All filesn/a
0 changes as expected