Documents the release process details.  There is an admin page already that indicates how to run the mojo.  See Release Processing Tool for more information.



The mapping tool supports a release process that takes into account end-of-editing cycle activities, some quality assurance, production of data files, and upgrading terminology versions when the time comes.  The release processing is specifically tailored to the needs of IHTSDO and maintenance of the RF2 complex and extended map refsets that are part of the SNOMED CT distribution.  (Note: in the below figure, all references to UAT are now handled on the RELEASE server)

The release process requires the ability for mappers to resume editing before the release cycle fully completes.  Thus, this release strategy calls for completing the actual release processing on the RELEASE server and feeding back to PROD the final state of the map.   Many of the steps can now be handled via the user interface, as described in this section Running the Release Process with the User Interface.  A more full accounting of the original manual steps can be found in the section below entitled Mapping Tool Release Process

Running the Release Process with the User Interface

Mapping Release Process Demo Tutorial

Pre-release steps

These steps will be run on PROD.

Release processing steps

These steps will be run on the RELEASE server after the clone is completed by WCI.  For the alpha, beta, member, and final versions of the international release, ALL of these steps will need to be run for each iteration (with the exception of Reload SNOMEDCT, which does not need to be run for alpha).  For the derivative releases, each of these steps will likely only be run once.

Finalize release steps

These steps will be executed on PROD after the release files have been copied back to the PROD server from the RELEASE server.

Running the Release Process from the Command Line

The following are the original details to produce a release with the command line interface and manually run mojos.  It still contains relevant information for running the steps that are not available through the user interface such as cloning the PROD db to the RELEASE server and the return of the produced release files back to PROD.

  1. PROD: Check Prod database for no tracking records on the project.
    1. Currently, we are doing a single clone for all four projects (ICD10, ICDO, GMDN, and ICPC), so make sure all projects are complete before cloning.
  2. PROD: Mappers stop editing.
  3. PROD: Disable drip feed (and other cron jobs)
    1. crontab -e (on the prod system)
  4. PROD: Allow nightly backup to run following "ready for release" state
  5. RELEASE: Cloning PROD Database to UAT
  6. PROD: Run "Begin New Editing Cycle" 
    1. Done via the "Start New Editing Cycle" button in the "Release Handling" accordion of the "Project Details" page
    2. This merely sets the editing cycle start date in the map project
    3. Mappers can commence editing for the following editing cycle
  7. PROD: Re-enable drip feed (and other cron jobs)
    1. crontab -e (on the prod system)
  8. RELEASE: Begin release (creates the "Release QA" report)
    1. Done via the "Begin" button in the "Release Handling" accordion of the "Project Details" page
    2. This produces a "Release QA" report which can be reviewed and fed into the QA workflow.
    3. Ensure all in-scope concepts are mapped and there are no validation errors.
    4. Double-check mapped, but out-of-scope concepts to ensure they should be out of scope.
    5. Mappers fix any blocker errors on the RELEASE server
  9. RELEASE: Obtain the alpha SNOMED release - /home/ihtsdo/data/SNOMEDCT/$version/...snapshot Refset/Terminology folders...
    1. The Snapshot Refset/Terminology directories should be downloaded to ~/data/SNOMEDCT/$version directory (replace any prior version data files)
    2. Remove the old SNOMED version from the system (using the Terminology Loader and Remover)
    3. Add new SNOMED version to the system (using the Terminology Loader and Remover)
  10. RELEASE: For each: alpha, beta, final SNOMED Release
    1. RELEASE: Obtain and load the (alpha, beta, final) SNOMED release
      1. e.g. use ~/data/SNOMED/$version, replace any older version data files, or archive them)
    2. RELEASE: Begin release (creates the "Release QA" report) 
      1. (see #2)
    3. Perform release (into /home/ihtsdo/data/doc/release/$release/$destinationTerminology)
      1. Done via the "Process" button in the "Release Handling" accordion of the "Project Details" page
      2. This generates the data files in ~/data/doc/release/$version/$destinationTerminology
  11. PROD: After final RELEASE run for production SNOMED release, copy the ActiveSnapshot file back to PROD (into /home/ihtsdo/data/doc/release/$release/$destinationTerminology)
  12. PROD: Run "Preview Finish" → produces "Release Finalization QA" report
    1. Done via the "Preview Finish" button in the "Release Handling" accordion of the "Project Details" page
    2. This generates a "Release Finalization QA"  report that summarizes changes between the map records in the release on PROD and what was generated on RELEASE
    3. This process expects the active snapshot RF2 file in ~/data/doc/release/$version/$destinationTerminology 
    4. SPECIAL NOTE: If changes made in RELEASE caused concepts to be removed from scope, or maps to be created to empty targets (for simple map projects like GMDN), these changes will not be AUTOMATICALLY sync'd to PROD, you will have to manually remove the concepts from scope on prod otherwise they will persist into the future.
  13. PROD: mappers/admins agree on planned changes
  14. PROD: Run "Finish" → replaces the map refset entries, fixes map records to match final state from RELEASE and marks them as PUBLISHED, and removes out of scope records.
    1. Done via the "Finish" button in the "Release Handling" accordion of the "Project Details" page
    2. This does 3 things
      1. applies any changes made in RELEASE to the PROD copies of the map records (to avoid duplicate editing) 
        1. Any records that will be changed are reported in the "Release Finalization QA" report.
      2. removes out of scope concepts/map records
      3. Marks "ready for publication" records as "published"
    3. This process expects the active snapshot RF2 file in ~/data/doc/release/$version/$destinationTerminology
  15. PROD: Remove old reports

For each of the currently supported IHTSDO mapping projects, there is a project-specific page for enacting the specific steps needed for that project.

NOTE: paths shown above start ~/data/doc/...., however in principle everything is relative to the directory specified in "map.principle.source.document.dir" in config.properties (in practice, this is set to "/home/ihtsdo/data/doc" in the PROD deployment.  We already had a property pointing to a local file system directory so it was reused.  TODO: in the future, this property should probably be renamed.

Creating Custom Release Processing

If the process above is not needed or desired, alternative release processing can be built as a custom development task.  Things to consider are:

These things are very project specific and are not the same for all projects.

Custom release processing can be implemented via an outside package, or in the mapping-custom project (see Custom Release Process).