Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

LESSONS LEARNT FROM OCTOBER/NOVEMBER:

  • We need to switch off the auto-message regarding the Drip Feed being switched off just after the content cut off at 23:00 - this causes disruption yet the drip feed still appears to run!  WCI investigating....
  • We need to strongly consider bringing the Content Cut Off forward to 12:00 the previous day - Maria agreed, so this will form part of the November 2021 schedule...:
    • a)  The handover to WCI was too fraught, with no confirmation of clean content cut off
    • b)  There was not enough time to run the SEP + Lateralizable refset generation process, in order to get the Provisional Pre-Prod release run the next morning, before the 12:00 Versioning cut off
    • c)  This way we can run the Final Handover meeting the day of the cut off (at say 12:00), and everyone can be on the same page with respect to the plan for the next day)
    • d)  We can also then run final content cross checks, ensuring that Maria no longer has to get up at 6am the next day to run them all through!
    • e)  The last promotion was naturally 12:00 that day anyway (in October), and so there was no business case to keep it open until 23:00
  • MAP FILES NOW NEED TO BE UPLOADED INTO THE TERMSERVER:
    • This is because otherwise they generate false positives in the new Traceability Assertion validation
    • We've therefore added a new upload process into the below schedule, for WCI to upload the map files to the termserver... see rows in Blue

...

Content Team to do everything possible to complete ALL promotions before the day of the Content Cut Off.  This is 15

Suzanne Santamaria Farzaneh Ashrafi

Content review for conflict with LOINC agreement.

12 - (October/November INT Releases ONLY) - DOUBLE CHECK THAT SEP + LATERALIZABLE REFSET GENERATION PROCESS HAS BEEN RUN BEFORE KICKING OFF TEST BUILD(s)12 release manager Donna Morgan12 - Mapping team to finalise any last mapping from the final content that came through after 12:00 content cut off (or any issues identified during the Release Mapping Server validation process), and then Resolve their "Mapping Complete" ticket to confirm that "Mapping QA complete".12:30 Content Release Leads  ()30 SI Team Tasks in snowStorm14?16:00? - Build of the final, Versioned Build + regression testing the latest version02:00 (or immediately after the Daily Build/Snapshot provided by DevOps post-versioning is available if Rick Wood  can automate this?) - WCI to completely remove SNOMED from the Release Mapping Server + upload .
  • 03:00 - WCI to validate the Release Mapping Server
  • 04:00 - WCI to lift maintenance window and allow Mapping Team to access other projects ONLY (GMDN, MedDRA, etc) Versioning 
    DateResponsibilityDeliverables

     

    Authoring begins for November 2021 International release.

    Check for and request updates to validation to align with large scale changes to content development (e.g. axiom, GCI, concrete domains etc).

    Content Release Manager to check Daily Build RVF report daily to ensure no failures in the "Traceability Service" assertion(s).  These will provide advanced notice of the type of failures we currently don't find until Release time (items missing from the RF2 manifest, package formatting issues, etc), so that they can be fixed well before the release.

      

    No further batch loads or bulk updates.

    No further promotion for projects that have large scale changes for example promotion from the Community Content or changes to foundational hierarchies likely to have impact across other content.

    Cross check that all MRCM changes have been made and the associated content changes completed (i.e. no MRCM errors on Main). No further changes to MRCM.

    Create the module dependency records for the next release.

    Content Team

    Notify Content Team about forthcoming release close and aim to complete project promotion in advance of cut off to prevent last minute issues for the Mapping Team.

    09:00 - Content Team Release Lead (Maria Braithwaite) to confirm initially that nothing has been/will be authored (that requires mapping) since the final Daily Build was run.  If it was, the Mapping Team needs to be informed immediately, so they can try and map it last minute before the 12:30 Mapping Cut Off.

    Preliminary content review for conflict with LOINC agreement.

    LOINC tasks to be promoted in LOINC project (where applicable) before content versioning.


    Last day for the Content team to promote any changes intended for release in the current editing cycle.

    12.00 - CONTENT CUT OFF - Final project promotion!

    Content team may continue to author after final project promotion and until the authoring platform is under maintenance window, but must not delete any concepts or components that have already been promoted for the November 2021 release. No project promotion until further notice.

     

    Release Team

    WCI (Rick Wood)

    • 02:00
    • (or immediately after the Daily Build/Snapshot provided by DevOps post-versioning is available if Rick Wood  can automate this?) - WCI to completely remove SNOMED from the Release Mapping Server + upload the latest version.
    • 03:00 - WCI to validate the Release Mapping Server
    • 04:00 - WCI to lift maintenance window and allow Mapping Team to access other projects ONLY (GMDN, MedDRA, etc)





    09:00 - Mapping team to finalise any last mapping from the final content that came through after yesterday's 12:00 content cut off (or any issues identified during the Release Mapping Server validation process), and then Resolve their "Mapping Complete" ticket to confirm that "Mapping QA complete".

    NB  this is using the content from yesterday's final promotion cut off at 12:00, as the Daily Build feed then ran at 01:00

    09:00 - Content

    Release Manager final content review and validation in the current release branch:

    • Confirm root concept has been updated - November 2021 release.
    • Review RVF report.
    • Review MRCM report.
    • Check the exceptions list for all components listed during the current release cycle.
    • Run 'Inactivated concept in ref set' report.
    • Spell check/ check descriptions file for inaccuracies or typos.
    • Reporting platform release validation section - KPI patterns, case sensitivity, duplicate terms, release issues report, validate inactivations report.
    • Reporting platform release statistic section - Concepts changed, Inactivated concepts, New components, New descriptions, Release stats, Summary component stats.

     

    Release Team

    09:00 - (October/November INT Releases ONLY) - DOUBLE CHECK THAT SEP + LATERALIZABLE REFSET GENERATION PROCESS HAS BEEN RUN BEFORE KICKING OFF TEST BUILD(s)

     

    11:00 - Initial handover meeting - once all signed off, full validation of initial content + fixing of all issues that it is possible to resolve before versioning.


    12:00

    - MAPPING CUTOFF

    12:

    00 -

    Content

    Release Manager to create 2x new

    tasks in authoring platform project 'Release mapping upload project', to accept the upload of the new Map files Delta's (one for SimpleMap + one for ExtendedMap delta files).

    Content Release Manager to email the 2x new tasks to WCI (Rick WoodDeborah Shapiro + support-si@westcoastinformatics.com) for use in the map uploads.

    WCI (Rick Wood)

    Mapping Generation process (ICD-0 + ICD-10) - November 2021

    NB  The mapping process will use the content from LAST NIGHT's final Daily Build (at 01:00).  This means that in theory something could slip through and remain unmapped, IF it's authored after the final Daily build and before the Content Cut Off (ie) between 01:00 - 12:00. 

    • 12:30 - Content Team Release Lead (Maria Braithwaite) to confirm definitively that nothing has been authored (that requires mapping) since the final Daily Build was run.  If it was, the emergency process needs to be invoked (see below)...13:00 - Manual/automated backup of Mapping Server - Chris Morristo automate when possible...
    • 1413:00 - WCI to SUSPEND DRIP FEED FOR TONIGHT
    • 1413:00 - Mapping Server is Cloned over to the Release Mapping Server (can be done immediately after the backup is complete if WCI can automate this?).  FYI   This is only necessary if there are definable risks of the Content changing between now and the Published Production release at the end of the month
    • 15:00 - WCI generate ICD-0 + ICD-10 map files and QA reports checked
      • Potential for some discussion with Donna if any red flags in these reports...
    • 16:00 - WCI send ICD-0 + ICD-10 FINAL map files to technical team Release manager (Andrew Atkinson) before close of play
    • 16:00 - WCI upload ICD-0 + ICD-10 FINAL map files (with BLANK EFFECTIVETIMES) to the termserver, using the RF2 Swagger upload process 
    • 16:30 - WCI to confirm to Content Release Manager (Maria Braithwaite) + Release Team (Andrew Atkinson) that map upload is complete and validation/promotion can continue.
    • 16:30 - Content Release Manager (Maria Braithwaite ) SI Content Team to validate + promote the two Map file tasks to MAIN
      • Backup plan:  If there is a Critical (P1) issue found in the final content (shouldn't be due to the new task/project validation, but we need an emergency process just in case), then WCI can import a specific fix branch straight into the Cloned Release Mapping Server, without bleed through from the next month's content.  However, this should only be used in the genuine emergency situations...


    14:00 - Final content review for conflict with LOINC agreement.

     

    Release Team

    16:00 - For the first few releases the Release Manager should run an initial full Release against the UN-VERSIONED content, to ensure no failures in the "Traceability Service" assertion(s) in the RVF report.  These will provide advanced notice of the type of failures we currently don't find until Release time (items missing from the RF2 manifest, package formatting issues, etc), so that they can be fixed well before the release.  

    Versioning to proceed once Release Manager confirms that there are no Critical issues in this build.

    ***** NOTE there will be some false positives in the new Traceability Assertions (assertionUuid: "b7f727d7-9226-4eef-9a7e-47a8580f6e7a") until the map files can be finalised and uploaded to the termserver (see below) the number of failures should exactly match the number of records across BOTH map file delta's - so if this is the case these can be ignored until the map files are uploaded to the termserver in a few days...

    15:00 - AAT to send request to WCI for preview Mapping files (ICD-0/ICD-10 only), for use in the pre-versioning validation Build first thing in the morning

    No need for this step anymore due to new mapping process...

     

    16:00 - Initial handover meeting - once all signed off, full validation of initial content + fixing of all issues that it is possible to resolve before versioning.

    Confirmed no critical issues for the November 2021 release - https://prod-rvf.ihtsdotools.org/api/result/1636994906144?storageLocation=international/international_edition_releases/2021-11-15T16:28:19 - only contains:

    • the expected MDRS + Traceability false positives
    • the expected Map file errors because the upload to the termserver didn't work as planned this time (should resolve post versioning)
    • the expected SEP failures because the automated generation is still not perfected

    17:00 - If any Critical fixes have been required, we need to:

    • Push them back through to MAIN before versioning
    • Re-run the Daily Build manually in order to ensure that the Mapping Server picks up

     

    WCI (Rick Wood)

    • the latest version

     

    11:00 - Final handover meeting - final cross check to ensure that all validation complete, and any last minute tasks (refset generation, final Mapping updates from last night's drip feed, etc) are complete before versioning green lit.

    12:00 - Technical team release tasks (as and when initial validation is signed off at each milestone)

    • termServer branching and Release versioning
    • Snapshot used to provisionally bring the AP validation etc back up again today, so that it works for the interim period until the new Production release package is signed off tomorrow (on the 16 Nov this cycle)...

    Reminder to WCI to cut off mapping drip feed (but NOT clone over to Release Server until Mapping Team confirms that both ICD-0/ICD-10 + GMDN maps are all updated based on Content + latest GMDN content.

    New versioned Release Build is created and validated by Release Manager

    ***** MANIFEST MUST BE CHANGED TO PULL MAP FILE DATA FROM SNOWSTORM INSTEAD OF EXTERNALLYMAINTAINED FOLDERS ******

    Final builds completed and validated:

    Once Final, versioned Release Build is signed off by Release Manager, it is handed over to DevOps to update the Daily Build, plus all AP validations, etc

    Maria Braithwaite

    ?18:00? - AUTHORING + MAPPING RE-COMMENCE

    Restart content editing for the next release cycle in the new release branch on authoring platform.

    Project promotion is also clear to commence from this point onwards.

    Maria Braithwaite SEND NOTICE to Content team members - all existing tasks must be rebased to prevent problems with the classification (until we can automate all rebases then rebasing the tasks is also needed. Dev Ops will still rebase all projects each release).

    Mapping Drip Feed switched back on (but mapping tool will not be back up to date until first drip feed run later tonight).

    WCI (Rick Wood)

    • 01:00 - Daily Build first run after Versioning 
    • 02:00 - Mapping Drip feed first run after
    • Versioning - WCI to inform SI Mapping Team that they can re-commence mapping
    • 09:00 - Donna and Mapping Team are able to re-start International Mapping work for the next cycle.

    -

    Full manual + automated validation of the versioned content.

    Lateralizable and SEP ref sets. (BUT ONLY IF NEW AUTOMATION OF THESE REFSETS IS STILL NOT YET AVAILABLE).

    -

    Preparation of release notes.  (NOT REQUIRED FOR NOVEMBER 2021 RELEASE).

    Handover of release notes to Technical release manager. (NOT REQUIRED FOR NOVEMBER 2021 RELEASE).

    -

    Share with external stakeholders for pre-Production release sent to relevant stakeholders for final review, plus fixing + regression testing of all issues identified.

    Andrew Atkinson

    Production internal release date.