MySQL Hosted Database Services Online

The outage started Thursday, March 21 around 10p.m. EDT and was restored around 12:00p.m. EDT on Friday, March 22.

Action Required
If you are the owner of a system on mysql.dipr.partners.org, we strongly encourage you to check your application connection and reboot if necessary.

Affected Services
All systems hosted on mysql.dipr.partners.org
Research Computing ticketing system (Kayako tickets.partners.org)
Research Computing ordering/request system (RC Services rcservices.partners.org)

We will update this posting once service has been restored. Please contact rcc@partners.org with any questions or concerns.

The hpcwin3.partners.org Windows analysis server has presented several freeze instances in the last few days. To evaluate the usage and logs we need to take the server out of service for a few days. During this window time we will perform test and review the information of the processes that have been causing the system to crash.  Future actions needed to be taken after for repair or control will be announced to the users. 

Existing remote desktop sessions will be terminated. Please save all open files and exit from your remote desktop session as soon as possible. We apologize for the inconvenience this may cause. 

We had an emergency issue that impacted mysql2.dipr.partners.org. To resolve this issue we rebooted mysql2.dipr.partners.org at 8:00pm on Monday evening March 04, 2019.

REDCap (https://redcap.partners.org/redcap) requires server maintenance which is scheduled for Saturday, February 23rd 2019 from 7:00AM to 9:00AM EST. There will be a short interruption of service during the maintenance window.

If you have any concerns about this scheduled maintenance, please email edcsupport@partners.org

The ERIS Infrastructure team will perform maintenance on mysql3.research.partners.org and mysql2.dipr.partners.org on Saturday morning February 23, 2019, from 7:00 am - 9:00 am. There will be a short interruption of service during the maintenance window. All databases hosted on mysql3.research.partners.org or mysql2.dipr.partners.org will be offline while we shut down and restart each node. 

Action Required
If you are the owner of a database on mysql3.research.partners.org or mysql2.dipr.partners.org we encourage you to check your applications after the maintenance window.

Partners HealthCare GitLab: Scheduled Downtime on 2/04/2019

The GitLab service (https://gitlab.partners.org/) will be upgraded from version 11.5.6 to version 11.5.7. The upgrade is scheduled to take up to 1 hour. During this time, the service will be unavailable between 7 AM to 8 AM on Monday, February 4th.

This upgrade will include:

• Critical security patches

For a complete list of changes, please refer to the GitLab project release notes:

• Version 11.5.7 -  https://about.gitlab.com/2019/01/16/critical-security-release-gitlab-11-dot-6-dot-4-released/

** Additionally, we want to reach out to the users of GitLab, to complete any necessary testing before the upgrade on Monday, February 4th at 7 AM. Please complete all your testing at this link: http://gitlab-dev.dipr.partners.org (** To login, just use your Partners ID and Password). The Development server is currently at version 11.5.7. Note – no projects or data have been copied over from the production server. You can create new projects in the development environment and conduct tests as necessary. Projects created in the development environment may be removed without notice (as we conduct future GitLab version testing).

If you any questions or concerns relating to this scheduled downtime, please email: rcc@partners.org

UPDATE: 09:45AM: The underlying issue has been corrected and Confluence is back on line.  We apologize for the inconvenience

UPDATE 08:45AM: The issue has been identified and ERIS technical teams are now working to resolve the issue.  ETA is ~11am EST

There is an issue with the infrastructure upon which Confluence relies causing Confluence to be unavailable.   ERIS technical teams are working to identify and fix the issue.

The enterprise is experiencing an issue with the Mail Gateway. Email sent via the List Manager service may not sent.

This is related to the Email Issue that was communicated on the morning of Monday, January 14 by IS Communications.

The GitLab service (https://gitlab.partners.org/) will be upgraded from version 11.5.5 to version 11.5.6. The upgrade is scheduled to take up to 1 hour.

During this time, the service will be unavailable between 7 AM to 8 AM on Monday, January 14th.

This upgrade will include:

• Critical security patches

For a complete list of changes, please refer to the GitLab project release notes:

• Version 11.5.6 - https://about.gitlab.com/2018/12/31/security-release-gitlab-11-dot-6-dot...

Please email rcc@partners.org with any questions or concerns.

MobileIron has scheduled an upgrade to the NA1 Cluster used by Partners and thousands of other customers tonight from 10pm through 8am.

The following will be affected during tonight’s MobileIron NA1 Upgrade:

• You will not be able to enroll new devices
• Existing MobileIron users will not be able to access the Partners App Catalog

Other functions such as Email, Haiku, Cortext, Receiver, Dropbox, PowerMic, etc are not affected and will continue to work normally

REDCap (https://redcap.partners.org/redcap) upgrades to v8.5.24 scheduled for Thursday August 9th at 7:30AM EDT are complete. REDCap was offline from 7:30-8:07AM EST.

 Full release notes can be found here. 

If you have any concerns about REDCap being offline at this time, please email edcsupport@partners.org

Important: New Method For Composing Survey Invitations!

One of the new features included in the upgrade to v.8.5.19 is the ability to fully customize survey invitations. The standard text and survey link are no longer automatically appended to the text you provide. 

For most users, the transition will be seamless. However, we recommend that users review any projects that utilize Automatic Survey Invitations to ensure their survey text is displaying as expected. 

For groups using the Twilio service, the projects should be reviewed as soon as possible, especially ones using Automated Survey Invitations. You may need to manually add in a reference to [survey-url] or [survey-link] into the text depending on your invitation preference.  

This is how the new feature is detailed in the REDCap release notes:

Improvement/change: New method for composing survey invitation text using Smart Variables for survey link

When composing a survey invitation, the standard text and survey link are no longer automatically appended to the survey invitation text at the time the email is sent. Instead, users must now specify all the entirety of the text of the email (including the stock text and survey link that used to be appended automatically, if they wish) and therefore must supply [survey-url] and/or [survey-link] in the text if they wish to provide the participant with a link to the survey.

If the user forgets to enter the survey URL Smart Variable in the text, REDCap will automatically suggest to them that they should.

If using the Twilio telephony module for sending invitations, the standard instructional text will still be appended in the SMS message as in previous versions EXCEPT for the “Email invitation” and “SMS invitation (contains survey link)” invitation types, which require [survey-url] and/or [survey-link] in the SMS text in order for the participant to receive a survey link.

Note: All survey invitations that were scheduled prior to this upgrade will still have the standard text and survey link appended to their survey text. Additionally, during the upgrade to this version, all saved configurations for Automated Survey Invitations (ASIs) will have the standard text and survey link automatically appended to the saved ASI email text, thus allowing the ASI behavior to remain exactly the same after the upgrade and allowing it to be backward compatible.