Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

September 2019 Pre-Production (Version5) vs September 2019 Production (Version1) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
SimpleMap files4441

4441 records had ID's updated, matching changes exactly to the 4411 added to the International Edition for CTV3 (as part of the normal authoring cycle updates, exported from the termServer - this is the exact expected amount as it matches exactly the number of new concepts created in the latest authoring cycle)

Therefore this is the expected result, as we never have US specific changes in this file

Readme file
MSSP-403

Updated to Production naming as expected, plus

5 documents removed from package, as agreed with NLM on 14/08/2019 in

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyMSSP-403

< doc_Icd10MapTechnicalGuideExemplars_Current-en-US_US1000124_20190901.xlsx
< doc_Icd10cmMapReleaseNotes_Current-en-US_US1000124_20190901.pdf
< doc_Icd10cmMapTechnicalGuideExemplars_Current-en-US_US1000124_20190901.xlsx
< doc_Icd10cmMapTechnicalSpecifications_Current-en-US_US1000124_20190901.pdf
< tls_Icd10cmHumanReadableMap_US1000124_20190901.tsv

Relationship files8ISRS-581

1 relationship record had both role group and ID changed, as it is getting a new identifier in each build because it does not already exist in the July 2019 International release as active or inactive (I also double checked that in the final Production International Release, the same ID was eventually used as that in this Production US release - THIS MEANS NO FURTHER CHANGES TO THIS RECORD SHOULD BE TOLERATED):

< 11583041026 20190731 1 900000000000207008 80660001 308490002 4 370135005 900000000000011006 900000000000451002

> 11576335029 20190731 1 900000000000207008 80660001 308490002 1 370135005 900000000000011006 900000000000451002

Plus 7 international relationship records had their role groups changed, as has already been confirmed to be valid by both Kai and Yong in

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyISRS-581
. (I also double checked that in the final Production International Release, the same role groups were eventually used in each record as that in this Production US release - THIS MEANS NO FURTHER CHANGES TO THESE RECORDS SHOULD BE TOLERATED)

< 3819331025 20190731 1 900000000000207008 449240007 412375000 3 127489000 900000000000011006 900000000000451002
> 3819331025 20190731 1 900000000000207008 449240007 412375000 2 127489000 900000000000011006 900000000000451002

< 3819332021 20190731 1 900000000000207008 449240007 396435000 1 127489000 900000000000011006 900000000000451002
> 3819332021 20190731 1 900000000000207008 449240007 396435000 4 127489000 900000000000011006 900000000000451002

< 3819333027 20190731 1 900000000000207008 449240007 396433007 2 127489000 900000000000011006 900000000000451002
> 3819333027 20190731 1 900000000000207008 449240007 396433007 1 127489000 900000000000011006 900000000000451002

< 3819334022 20190731 1 900000000000207008 449240007 428126001 4 127489000 900000000000011006 900000000000451002
> 3819334022 20190731 1 900000000000207008 449240007 428126001 3 127489000 900000000000011006 900000000000451002

< 6777054028 20190731 1 900000000000207008 722095005 385315009 1 263502005 900000000000011006 900000000000451002
> 6777054028 20190731 1 900000000000207008 722095005 385315009 5 263502005 900000000000011006 900000000000451002

< 6777055027 20190731 1 900000000000207008 722095005 80891009 5 363698007 900000000000011006 900000000000451002
> 6777055027 20190731 1 900000000000207008 722095005 80891009 1 363698007 900000000000011006 900000000000451002

< 9279742024 20190731 1 900000000000207008 80660001 363808001 1 363714003 900000000000011006 900000000000451002
> 9279742024 20190731 1 900000000000207008 80660001 363808001 4 363714003 900000000000011006 900000000000451002

Relationship files

ISRS-637

Manual Classification FAILED -

0 Equivalencies (as expected), BUT

939 Results - NOT EXPECTED

sct2_Relationship_Delta_Classification_20190816.txt

Kai confirmed no issue here, as the problem lies with the manual classification API (https://prod-classification.ihtsdotools.org/classification-service/swagger-ui.html#!/classification-controller/createClassificationUsingPOST), which cannot currently cope with the multiple effectiveTimes in the Delta that is (so far) unique to the US Edition... ticket

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyMAINT-836
raised to resolve this going forward...


September 2019 Pre-Production (Version4) vs September 2019 Pre-Production (Version5) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
Relationship files270

ISRS-597

270 records inactivated as expected, as per Michael's classification bug fix in ISRS-597

Manual Classification FAILED -

0 Equivalencies (as expected), BUT

12 Results - NOT EXPECTED

sct2_Relationship_Delta_Classification_20190808.txt


September 2019 Pre-Production (Version3) vs September 2019 Pre-Production (Version4) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
Relationship filesn/a

Manual Classification FAILED -

0 Equivalencies (as expected), BUT

282 Results - NOT EXPECTED

sct2_Relationship_Delta_Classification_20190801.txt

Transitive Closure file288166

188030 records removed, plus

288166 records added

....for Sept 2019 - roughly as expected, as similar to previous changes:

  • Sept18 - Mar19 Diff = 379465


September 2019 Pre-Production (Version2) vs September 2019 Pre-Production (Version3) traceability

Identical

September 2019 Pre-Production (Version1) vs September 2019 Pre-Production (Version2) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
Stated Relationship files58ISRS-588

58 records inactivated as expected, due to MICHAEL's fix in ISRS-588


March 2019 (PUBLISHED) vs September 2019 Pre-Production (Version1) traceability

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
ExtendedMap files20157

3374 records updated, plus

5892 records inactivated, plus

10871 records added

Need to verify this with WCI + Kin Wah.... Kin Wah confirmed they don't keep logs!

  • Sept18 - Mar19 Diff = 36,100
  • Setp19 US Extension changes = 18101

So roughly the right amount given the previous number of changes

SEND TO JULIA and KIN WAH TO VERIFY ONCE HAVE FINAL VERSION

AssociationReference files6903

456 records updated, plus

1687 records inactivated (57 MORE than International Edition), plus

4751 records added (10 MORE than International Edition)

US Edition specific changes are related to ...

  • Sept18 - Mar19 Diff = 5775 (including 63 US Specific changes)
  • Setp19 US Extension changes = 11

> 20190901 1 731000124108 900000000000527005 12239341000119100 787051000
> 20190901 1 731000124108 900000000000527005 12239381000119105 787052007
> 20190901 1 731000124108 900000000000527005 15692721000119107 15992511000119105
> 20190901 1 731000124108 900000000000527005 15741081000119104 773846000
> 20190901 1 731000124108 900000000000527005 16602691000119104 784243001
> 20190901 1 731000124108 900000000000527005 434971000124109 7761000119106
> 20190901 1 731000124108 900000000000527005 435061000124102 40271000119102
> 20190901 1 731000124108 900000000000527005 435221000124104 784375000
> 20190901 1 731000124108 900000000000527005 435231000124101 784376004
> 20190901 1 731000124108 900000000000527005 458601000124101 10821131000119109
> 20190901 1 731000124108 900000000000527005 690801000119108 783706007

Spot checks look good, with 14 inactivations + 7 equivalencies resolved, as confirmed in Penni's spreadsheet:

https://docs.google.com/spreadsheets/d/1uo__1Ud3WQVKu_gEZoO09Voc29SAUxL2Aj7I0N5viIE/edit#gid=0


tls_Icd10cmHumanReadableMap_US1000124_20170901.tsv

0
Should be changes for Sept 2019???????? Need to check and update in ExternallyMaintainedRefset folder if so...

doc_Icd10cmMapTechnicalSpecifications_Current-en-US_US1000124_20170901.pdf

0
Should be changes for Sept 2019???????? Need to check and update in ExternallyMaintainedRefset folder if so...

doc_Icd10cmMapTechnicalGuideExemplars_Current-en-US_US1000124_20170901.xlsx

0
Should be changes for Sept 2019???????? Need to check and update in ExternallyMaintainedRefset folder if so...

doc_Icd10cmMapReleaseNotes_Current-en-US_US1000124_20170901.pdf

0
Should be changes for Sept 2019???????? Need to check and update in ExternallyMaintainedRefset folder if so...

doc_Icd10MapTechnicalGuideExemplars_Current-en-US_US1000124_20170901.xlsx

0
Should be changes for Sept 2019???????? Need to check and update in ExternallyMaintainedRefset folder if so...
RefsetDescriptor files1 record

ISRS-583

1 record updated with the new attributeType ("URL" instead of "parsable string), as expected in ISRS-583, as in the International Edition:

< a87a81a3-b10c-490b-9cc1-d94fafc5dc27 20170731 1 900000000000012004 900000000000456007 723560006 723570008 707000009 7

> a87a81a3-b10c-490b-9cc1-d94fafc5dc27 20190731 1 900000000000012004 900000000000456007 723560006 723570008 900000000000469006 7

This is in line with the International editing cycle.

Therefore there are no US specific changes tis cycle

Readme file
n/aUpdated to reflect new EffectiveTime as expected
ModuleDependency filesALLn/a

6 records updated with latest effectiveTimes, as expected:

< 1244116f-fdb5-5645-afcc-5281288409da 20190131 1 900000000000207008 900000000000534007 900000000000012004 20190131 20190131
< 53773521-fd81-5dde-9a2d-8b87e8803251 20190301 1 5991000124107 900000000000534007 731000124108 20190301 20190131
< 686fe392-d2f7-586d-98aa-078aba426832 20190131 1 449080006 900000000000534007 900000000000207008 20190131 20190131
< 70edb2ac-8a7a-5a94-b385-f8ad80db3858 20190301 1 731000124108 900000000000534007 900000000000012004 20190301 20190131
< 71ae8ceb-7984-550c-b1f5-9a69681b383a 20190301 1 731000124108 900000000000534007 900000000000207008 20190301 20190131
< f6431457-161b-5b46-9217-573c20c00070 20190131 1 449080006 900000000000534007 900000000000012004 20190131 20190131
---
> 1244116f-fdb5-5645-afcc-5281288409da 20190731 1 900000000000207008 900000000000534007 900000000000012004 20190731 20190731
> 53773521-fd81-5dde-9a2d-8b87e8803251 20190901 1 5991000124107 900000000000534007 731000124108 20190901 20190731
> 686fe392-d2f7-586d-98aa-078aba426832 20190731 1 449080006 900000000000534007 900000000000207008 20190731 20190731
> 70edb2ac-8a7a-5a94-b385-f8ad80db3858 20190901 1 731000124108 900000000000534007 900000000000012004 20190901 20190731
> 71ae8ceb-7984-550c-b1f5-9a69681b383a 20190901 1 731000124108 900000000000534007 900000000000207008 20190901 20190731
> f6431457-161b-5b46-9217-573c20c00070 20190731 1 449080006 900000000000534007 900000000000012004 20190731 20190731


Transitive Closure file0

NO Changes made for Sept 2019 - NOT expected, need to update

  • Sept18 - Mar19 Diff = 379465
  • Setp19 US Extension changes =
SimpleMap files4442

2 records inactivated, plus

4440 records added

This matches the International Edition changes exactly, as 4411 added for CTV3 (as part of the normal authoring cycle updates, exported from the termServer - this is the exact expected amount as it matches exactly the number of new concepts created in the latest authoring cycle)

+ 31 new/updated records for ICD-0 as expected, matching the 31 records in the Delta from mapping tool.

  • Sept18 - Mar19 Diff = 11905 International change, 0 US changes
  • Setp19 US Extension changes = 0

Therefore this is the expected result, as we never have US specific changes in this file

Simple refset files104

20 records inactivated, plus

84 records added

This is as expected from the Lateralizable Refset changes that Yong made in this cycle for the International Edition, with no additional US changes found

  • Sept18 - Mar19 Diff = 172 International change, 0 US changes
  • Setp19 US Extension changes = 0

Therefore this is the expected result, as we never have US specific changes in this file

Concept files10049

2524 records updated (48 MORE than International Edition), plus

3165 records inactivated (33 MORE than International Edition), plus

4360 records added (81 LESS THAN than International Edition!!!!)

US Edition specific changes are related to ...

HOW ARE THERE LESS NEW RECORDS THAN IN THE INT EDITION?!!

Analysis:

These 81 records must have been DONATED from US to International Content - in this way the International Edition will have 81 more "NEW" concepts than the US Edition (as they will now be inactive or had their module updated in the US Edition). Therefore, the fact that the additional updated/inactviated records in the US Edition (as compared to the International) are 33 + 48 = 81, means that this proves that the donated content makes up for the drop in "New" concepts in the US Edition.


Description files

19582


184 records updated (48 MORE than International Edition), plus

4110 records inactivated (62 MORE than International Edition), plus

15288 records added (74 LESS THAN than International Edition!!!!)

US Edition specific changes are related to ...

HOW ARE THERE LESS NEW RECORDS THAN IN THE INT EDITION?!

See Concept discrepancy explanation above for reason behind this (donated content)

OwlExpression files357612

0 records updated, plus

0 records inactivated, plus

357612 records added (6778 MORE than International Edition - Michael confirmed this is about the right number - 6776 diff's in US Extension also collaborates this)

Stated Relationship files834934

814884 inactivated, BUT ONLY

834876 updated in total, MEANING 58 RECORDS STILL NOT INACTIVATED!

MICHAEL WORKING ON THIS IN ISRS-588

***** CHECK THIS IS FIXED IN NEXT VERSION....

Relationship files

266130

198500


152720 records updated (554 MORE than International Edition), plus

45780 records inactivated (3 LESS than International Edition), plus

67630 records added (10611 MORE THAN than International Edition!!!!)

US Edition specific changes are related to ...

  • Sept18 - Mar19 Diff = 250,018 International changes + 8512 US changes
  • Setp19 US Extension changes = 7164

These figures are roughly correct as compared to Extension + the previous amount of changes - HOWEVER WE STILL NEED TO CLASSIFY THIS SEPARATELY ON THE COMMAND LINE TO DOUBLE CHECK NO RESULTS...

TextDefinition files688n/a

25 records inactivated, plus

663 records added, as with the International editing cycle.

Therefore there are no US specific changes tis cycle

Attribute Value files16439

1200 records updated, plus

196 records inactivated, plus

15043 records added

This is only 64 changes more than the International Edition - therefore the US specific changes are....

  • Sept18 - Mar19 Diff = 36509 International changes + 214 US changes
  • Setp19 US Extension changes = 64

Spot checks look good, with 14 inactivations + 7 equivalencies resolved, as confirmed in Penni's spreadsheet:

https://docs.google.com/spreadsheets/d/1uo__1Ud3WQVKu_gEZoO09Voc29SAUxL2Aj7I0N5viIE/edit#gid=0

Language files39741

1023 records updated (19 MORE than International Edition), plus

7906 records inactivated (91 MORE than International Edition), plus

30812 records added (68 LESS than International Edition (because of Int replacements below))

68 records removed (replaced with Int records??EXPECTED??)

(eg)

< 673037bc-b9e8-5169-a3c0-0a4d3dea1ddf 20160301 1 731000124108 900000000000509007 724031000124115 900000000000548007
> 673037bc-b9e8-5169-a3c0-0a4d3dea1ddf 20190731 1 900000000000207008 900000000000509007 724031000124115 900000000000548007

These were definitely added to Int in the 20190731 release, so makes sense that they then replaced the US content - ONLY questions are :

  1. Do these align with the promoted content (Rory sending me concepts) - Yes, spot checks look good, and Rory sent the final Promoted concepts through: US Promoted concepts.txt - 64 of them roughly matches 68 removed records, and Rory confirmed (in Slack at 18:15 on 26/07/2019) that this was the exact intention in order to fix the UUID promotion issue in ISRS-580
  2. Should the promotion mechanism just update the moduleID (from US to Int) without inactivating the records? (ie) is moduleID mutable? YES, SEE TIG - 5.2.4 Language Reference Set - and Rory confirmed (in Slack at 18:15 on 26/07/2019) that this worked in the exact intended way in order to fix the UUID promotion issue in ISRS-580

+ 38 inactivations + 4 records added

  • Sept18 - Mar19 Diff = 143,110 International changes + 1972 US changes
  • Setp19 US Extension changes = 42
MRCMAttributeDomain files38 recordsISRS-564

5 Jan 2019 Published records (for Domain 373873005) inactivated, plus

5 July 2019 Beta records newly added (for Domain 781405001) to replace them, as expected in ISRS-564:

< 03b4720d-5840-41d5-bcf4-884c603acc28 20190731 1 900000000000012004 723561005 774158006 781405001 0 0..1 0..0 723597001 723596005
> 03b4720d-5840-41d5-bcf4-884c603acc28 20190731 0 900000000000012004 723561005 774158006 373873005 0 0..1 0..0 723597001 723596005

< 16965a9c-e4ba-4348-9b45-03150f74986c 20190731 1 900000000000012004 723561005 774161007 781405001 1 0..* 0..1 723597001 723596005
> 16965a9c-e4ba-4348-9b45-03150f74986c 20190731 0 900000000000012004 723561005 774161007 373873005 1 0..* 0..1 723597001 723596005

< b1bfe4c7-b443-45fa-9653-108093235e5a 20190731 1 900000000000012004 723561005 774160008 781405001 1 1..* 1..1 723597001 723596005
> b1bfe4c7-b443-45fa-9653-108093235e5a 20190731 0 900000000000012004 723561005 774160008 373873005 1 1..* 1..1 723597001 723596005

< f3a97490-6c74-404e-a3e9-436b7d4ca2a1 20190731 1 900000000000012004 723561005 774159003 781405001 0 0..1 0..0 723597001 723596005
> f3a97490-6c74-404e-a3e9-436b7d4ca2a1 20190731 0 900000000000012004 723561005 774159003 373873005 0 0..1 0..0 723597001 723596005

< be279b7b-2331-496c-b3e6-51b94df106fc 20190731 1 900000000000012004 723561005 774163005 781405001 1 0..* 0..1 723597001 723596005
> be279b7b-2331-496c-b3e6-51b94df106fc 20190731 0 900000000000012004 723561005 774163005 373873005 1 0..* 0..1 723597001 723596005

> 391f932e-3158-47bb-a95e-a2b1c19e864d 20190731 1 900000000000012004 723561005 774158006 781405001 0 0..1 0..0 723597001 723596005
> 9750d7b6-1c02-4d0d-baaf-b7c4c57ac10d 20190731 1 900000000000012004 723561005 774160008 781405001 1 1..* 1..1 723597001 723596005
> adcd86d6-5e43-4696-8165-46b8164b7de9 20190731 1 900000000000012004 723561005 774159003 781405001 0 0..1 0..0 723597001 723596005
> b631c3bd-33b7-4384-bff8-e9a614255be4 20190731 1 900000000000012004 723561005 774161007 781405001 1 0..* 0..1 723597001 723596005
> dae6b6b9-f00a-4128-ac20-c9e8f35f4804 20190731 1 900000000000012004 723561005 774163005 781405001 1 0..* 0..1 723597001 723596005

Plus one new record added as part of the initial International upgrade:

> 07805dc4-f785-48f1-a7b0-b089b29f1c4e20190731190000000000001200472356100578427600278140500101..10..0723597001723596005

All in line with the International edition changes, as expected.


MRCMAttributeRange files32 recordsn/a

7 records updated, plus

2 records inactivated, plus

2 records added

This is due to the following changes to the International Edition:

5 records had the DomainID changed, as expected in ISRS-564

< 2affaf44-9365-4d6d-84d3-31409206a77a 20190131 1 900000000000012004 723562003 774158006 << 774167006 | Product name (product name)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 774158006 |Has product name| = << 774167006 | Product name (product name)| 723597001 723596005
> 2affaf44-9365-4d6d-84d3-31409206a77a 20190731 1 900000000000012004 723562003 774158006 << 774167006 | Product name (product name)| << 781405001 |Medicinal product package (product)|: [0..1] 774158006 |Has product name| = << 774167006 | Product name (product name)| 723597001 723596005

< 355c9063-7238-4409-81a8-13f22b2a8bff 20190131 1 900000000000012004 723562003 774161007 < 260299005 |Number (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..*] { [0..1] 774161007 |Has pack size| = < 260299005 |Number (qualifier value)| } 723597001 723596005
> 355c9063-7238-4409-81a8-13f22b2a8bff 20190731 1 900000000000012004 723562003 774161007 < 260299005 |Number (qualifier value)| << 781405001 |Medicinal product package (product)|: [0..*] { [0..1] 774161007 |Has pack size| = < 260299005 |Number (qualifier value)| } 723597001 723596005

< 608ab6f5-6830-4294-926a-5c3a20b62060 20190131 1 900000000000012004 723562003 774159003 << 774164004 | Supplier (supplier)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..1] 774159003 |Has supplier| = << 774164004 | Supplier (supplier)| 723597001 723596005
> 608ab6f5-6830-4294-926a-5c3a20b62060 20190731 1 900000000000012004 723562003 774159003 << 774164004 | Supplier (supplier)| << 781405001 |Medicinal product package (product)|: [0..1] 774159003 |Has supplier| = << 774164004 | Supplier (supplier)| 723597001 723596005

< e491647d-1793-4b20-b92d-c1180a96b00f 20190131 1 900000000000012004 723562003 774163005 << 767524001 |Unit of measure (qualifier value)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..*] { [0..1] 774163005 |Has pack size unit| = << 767524001 |Unit of measure (qualifier value)| } 723597001 723596005
> e491647d-1793-4b20-b92d-c1180a96b00f 20190731 1 900000000000012004 723562003 774163005 << 767524001 |Unit of measure (qualifier value)| << 781405001 |Medicinal product package (product)|: [0..*] { [0..1] 774163005 |Has pack size unit| = << 767524001 |Unit of measure (qualifier value)| } 723597001 723596005

< e5945adf-c075-4fb7-8f1b-515a124326cf 20190131 1 900000000000012004 723562003 774160008 << 763158003 |Medicinal product (product)| << 373873005 |Pharmaceutical / biologic product (product)|: [0..*] { [0..1] 774160008 |Contains clinical drug| = << 763158003 |Medicinal product (product)| } 723597001 723596005
> e5945adf-c075-4fb7-8f1b-515a124326cf 20190731 1 900000000000012004 723562003 774160008 << 763158003 |Medicinal product (product)| << 781405001 |Medicinal product package (product)|: [1..*] { [1..1] 774160008 |Contains clinical drug| = << 763158003 |Medicinal product (product)| } 723597001 723596005

Plus the other changes made throughout the International editing cycle.

Therefore there are no US specific changes tis cycle


MRCMDomain files11 recordsn/a

9 records updated, plus

1 inactivated, plus

1 new record added, as with the International editing cycle.

Therefore there are no US specific changes tis cycle