Service Alerts

yellow - pre-downtime, calls to action

rc.partners.org Website Maintenance

January 28, 2018 10:00 am - 11:00 am

Research IS & Computing website maintenance is scheduled for Sunday, January 28, 2018 between 10-11a.m. EST. The site will be offline for approximately 15 minutes to apply security updates.

yellow - pre-downtime, calls to action

DIPR File Server Maintenance

January 28, 2018 10:00 am - 2:00 pm

The ERIS DIPR File Server (fs.dipr.partners.org) will be moved to a new Virtual Machine (VM) on Sunday, January 28, 2018 between 10a.m. - 2p.m. EDT 

During this maintenance window, any applications and systems that have storage associated with this server will be offline for approximately one hour.
 
ERIS DIPR File Server (fs.dipr.partners.org) is the nfs file server which provides mounted storage to our DIPR environment.
 
Actions Required for DIPR VM Owners

  • Before the maintenance, please check if you are using the Fully Qualified Domain Name (FQDN) or the IP Address to connect to this server. If you are using the IP Address, please replace it with the Domain Name, fs.dipr.partners.org
  • After the maintenance, we strongly encourage you to check the status of your VM once the scheduled work concludes. If you find one unresponsive, reboot or remount the storage. If any issues persist, please contact rcc@partners.org and we'll address the problem. 

Please contact rcc@partners.org if you have any questions or concerns about this maintenance.


To minimize disruption, ERIS will complete all non-critical changes such as patching, firmware updates, etc. on the last Sunday of every month from 8a.m. to 8p.m. The exact schedule outlined in the Knowledge Base. There have been a few adjustments for holidays and to avoid conflict with the Monthly Information Systems Maintenance (ISM) window. 

green - services online

Monthly Information Systems Maintenance (ISM)

January 8, 2018 12:00 am - 4:00 am

Applies To: All Users

Information Systems Maintenance (ISM) was conducted on Monday, December 18th from 12:00 am to 4:00 am.

During this time, planned system maintenance and testing was performed by IS Operations teams. This routine maintenance reduces the risk of unscheduled outages on our computer network and to the Internet.

Impact to systems and applications

  • VPN should be available during the ISM.

Impact to sites

  • Services or resources hosted in the Partners HealthCare data centers may be unavailable during the ISM.
  • Your site's IS Management team will provide more detailed communication about planned outages at your facility and will coordinate with specific groups that may be impacted.

Need help during the downtime? 

View the Broadcast Online. Please contact your IS Service Desk if you have any questions.

View the 2018 IS System Maintenance (ISM) Schedule in the IS Service Desk Knowledgebase (Partners login required).

green - services online

Partners email issue resolved for Apple's native Mail client

January 3, 2018 7:00 am - 3:30 pm

Changes were made on the Partners IS Okta (Secure Login) instance that temporarily blocked Partners email from reaching Apple’s native Mail client on macOS High Sierra 10.13.

Partners IS adjusted the Okta settings and Partners email is now working for those using Apple’s native Mail client. There are no extra steps required.

If you continue to experience an issue, please contact the IS Service Desk.

green - services online

LimeSurvey Unexpected Downtime

December 29, 2017 3:03 pm - 6:03 pm

LimeSurvey (https://limesurvey.partners.org/limesurvey) experienced an unexpected outage due to network issues from 2:00-2:18PM EST on Dec. 29th, 2017.  

If you have any concerns, please email edcsupport@partners.org

green - services online

REDCap Unexpected Downtime

December 29, 2017 2:34 pm

REDCap (https://redcap.partners.org/redcap) experienced an unexpected outage from 2:00-2:18PM today. It is back online.

Please review your projects if surveys were scheduled to send during this time.  Manage Survey Participants > Survey Invitation Log.  You can filter on “Invitations that failed to send” and resend as needed.

Survey data may not have been collected at this time and participants received a web-browser error message when attempting to click on a survey link.

If you have any concerns, please email edcsupport@partners.org

yellow - pre-downtime, calls to action

Microsoft Windows Patch Tuesday

December 12, 2017 9:00 am

Did you know that Microsoft regularly releases security patches for its software products on the second Tuesday of every month? How frequently do you update your computer? Here is some guidance to keep your device secure and your Microsoft software up to date and running smoothly.

Do I need to make changes on my computer?

  • Not if you use a Partners standard Windows computer (those with the asset tag, yellow lock and Partners' screensaver). The updates are run for you and devices are usually patched the Friday following Patch Tuesday. Both Microsoft and Adobe products are typically updated at this time. This can change if there is a significant freeze in place. 
  • Yes, you need to run updates if you use a non-standard Windows, Macintosh or personally-owned device for Partners' business. ​It is your responsibility to keep your device and software up to date. 

See HOWTO: Run Windows Updates for additional instructions.

green - services online

Monthly Information Systems Maintenance (ISM)

December 18, 2017 12:00 am - 4:00 am

Applies To: All Users

Information Systems Maintenance (ISM) was conducted on Monday, December 18th from 12:00 am to 4:00 am.

During this time, planned system maintenance and testing was performed by IS Operations teams. This routine maintenance reduces the risk of unscheduled outages on our computer network and to the Internet.

Impact to systems and applications

  • VPN should be available during the ISM.
  • Sunquest will not be available for user within the labs for approximately 1:15 a.m. to 2:30 a.m.
    • During the Epic downtime, specimen labels will not print in patient care areas or from hand held Collection Manager devices
  • Partners eCare - unavailable from 1:00 am until 4:00 am
    • Impacts all PeC applications and related interfaces.
    • Impacts PeC dependent applications including Patient Gateway
  • HealthShare - unavailable from 1:15 am to 3:15 am
    • Impacts all data interfaces and web services to PeC Production
  • All Cache Classic applications, except web paging, will be down from 1:00 am to 3:00 am.
  • The Specific applications within Cache that will be down are listed below:
    • Partners-wide: LMR, Medication and Allergy Services, CAS, EMPI
    • BWH:  Historical Order and eMAR Viewerother PeC dependencies
    • MGH: MGH OR Application, Historical Order and eMAR Viewerother PeC dependencies
    • All Cache Classic and Ensemble data interfaces and web services will be unavailable from 1:00 am to 3:00 am.

Impact to sites

  • Services or resources hosted in the Partners HealthCare data centers may be unavailable during the ISM.
  • Your site's IS Management team will provide more detailed communication about planned outages at your facility and will coordinate with specific groups that may be impacted.

Need help during the downtime? 

View the Broadcast Online. Please contact your IS Service Desk if you have any questions.

View the 2017 IS System Maintenance (ISM) Schedule in the IS Service Desk Knowledgebase (Partners login required).

green - services online

Shared Webhosting Upgraded on 12/17 9PM-10PM

December 17, 2017 9:00 pm - 10:00 pm

ERIS Shared Webhosting was upgraded on 12/17 9PM-10PM

 

Sunday 12/17 at 9PM to 10PM our shared webhosting admin site (Plesk) has been upgraded from version 12.5 to version 17.5. During the upgrade your website was not accessible. Some new features of this new version are listed below:

 

  • Support for PHP7
  • Support for Ruby and Node.js frameworks and developed apps
  • Git Support - To make deploying your website even easier
    • Easily deploy your website content by either pushing it to a local Git repository or by pulling from a remote one.
    • Create multiple branches in a single repository – useful for separating staging and production code.
    • Deploy manually for complete control or enable automatic deployment to save time.
    green - services online

    MySQL3 Server Updated on 12/17/17 at 10a.m. EST

    December 17, 2017 10:05 am - 10:20 am

    Applies to
    All databases and systems connecting to the MySQL hosted database system, mysql3.research.partners.org

    The myql3.research.partners.org server was updated on Sunday, December 17, 2017 to apply security patches and scans. The work was conducted from 10-10:20a.m. EST.

    Impact
    All databases will be offline during this maintenance window. Systems managed by ERIS were reconnected when the work concluded.

    Action required
    If you are the owner of a database on mysql3.research.partners.org, we strongly encourage you to check and reconnect our systems. 

    Please contact rcc@partners.org if you have any questions or concerns.

    green - services online

    rc.partners.org Website Downtime

    December 2, 2017 10:15 am - 10:45 pm

    This Research IS & Computing website, https://rc.partners.org, was offline during the MySQL3 Server Patching Maintenance Window.

    The site was safely restored as soon as the work is complete.

    green - services online

    MySQL3 Server Update Completed on 12/2/17

    December 2, 2017 10:15 am - 10:45 pm

    Applies to
    All databases and systems connecting to the MySQL hosted database system, mysql3.research.partners.org

    The myql3.research.partners.org server was updated on Saturday, December 2, 2017 to apply security patches and scans. Downtime was about 25 minutes between 10:15-10:45a.m. 

    Action required
    If you are the owner of a database on mysql3.research.partners.org, we strongly encourage you check and reconnect your system if needed.

    Please contact rcc@partners.org if you have any questions or concerns.


    Do you wish to receive alerts about this service? You can subscribe to receive email notifications for the ERIS-hosted MySQL platform. For a full listing of services with subscription lists for alerts, visit the ERIS SLA page.

    green - services online

    Freezerworks Service Alert: Upgrade to 2017

    November 22, 2017 3:00 pm - November 28, 2017 3:00 pm

    Partners Healthcare Freezerworks: Scheduled Downtime

    A major upgrade to Freezerworks (from version 5.2 to version 9.0) completed November 22nd at 3 pm - November 28th at 3pm. 

    • Freezerworks 2017 is now accessible on Partners PC via the Partners Menu,and users will be able to access the system via their Partners login name and password. Initial install will take  5-10 minutes on a standard PC.
    • Your Freezerworks account will now be associated with a designated role (PI, Lab Administrator, or User).
    • User manual & release notes information:
      • The updated user manual can be accessed: click here
      • The complete release notes can be accessed: click here
    • For those groups who have used the demo version of Freezerworks 2017, please uninstall that version with the following instructions:
      • Navigate to ‘my computer’, double click C: drive, and select ‘freezerworks 2017 client 9.0.00’
      • Uninstall the demo version by double clicking ‘unins000’ and proceed with the uninstall instructions

    **Training Sessions: the first one is scheduled for December 6th from 1:00 – 2:30 pm and will be recorded and distributed. We will plan additional training sessions and office hours to offer assistance any potential issues or guidance in using new features.  

    For those groups who use reports, we strongly recommend users select ‘Verify your upgrade reports’ for information that you may have to edit for reports in the upgraded version of Freezerworks.

    If you have any concerns about Freezerworks being offline at this time, please email rcc@partners.org

    ----------

    Additionally, we will schedule Freezerworks user sessions which will be announced soon to demonstrate new features. (To watch a short 6-minute demo on these new features, please click here)

    green - services online

    REDCap Scheduled Downtime

    November 15, 2017 12:51 pm

    REDCap (https://redcap.partners.org/redcap) upgrades to v7.4.19, scheduled for Friday November 17th at 6:30 AM EDT are complete. REDCap was offline from 6:30-6:46 AM EDT.

    This minor upgrade addresses a number of bugs introduced in the upgrade to version 7.4.16. 

    Full release notes found here.

    If you have any concerns about REDCap being offline at this time, please email edcsupport@partners.org


    REDCap Report FY17!: See how far REDCap has come at Partners HealthCare since 2009 and where we stand today. Please click here to view the report.


    REDCap Fall 2017 User Sessions at MGH:

    REDCap API: Wednesday, 11/29 9:30-11am
    REDCap Getting Started: Thursday, 11/30 9:30-11am
    REDCap User: New Release / Features: Wednesday, 12/6 9:30-11am
    REDCap eConsent: Thursday, 12/7 9:30-11am

    Please click here to register.

    BWH sessions to be announced soon. 

    green - services online

    RISC Website Maintenance | rc.partners.org

    November 6, 2017 7:05 pm - 7:20 pm

    Research IS & Computing website maintenance was scheduled for Monday, November 6, 2017 starting at 7p.m. The site was offline for approximately fifteen minutes for security updates, bug fixes and feature enhancements. 

    green - services online

    REDCap: Scheduled Downtime

    November 1, 2017 2:15 pm

    REDCap (https://redcap.partners.org/redcap) upgrades to v7.4.16 are scheduled for Tuesday November 7th at 6:30 AM EDT. Expected downtime is 45 minutes. 

    This minor upgrade addresses a number of bugs introduced in the upgrade to version 7.4.11. 

    Full release notes found here

    If you have any concerns about REDCap being offline at this time, please email edcsupport@partners.org


    REDCap Report FY17!: See how far REDCap has come at Partners HealthCare since 2009 and where we stand today. Please click here to review the report. 


    REDCap Fall 2017 User Sessions at MGH:

    REDCap API: Wednesday, 11/29 9:30-11am
    REDCap Getting Started: Thursday, 11/30 9:30-11am
    REDCap User: New Release / Features: Wednesday, 12/6 9:30-11am
    REDCap eConsent: Thursday, 12/7 9:30-11am

    Please click here to register.

    BWH sessions to be announced soon. 

    green - services online

    Update: No Email Changes for Apple’s Native Mail client

    September 20, 2017 12:00 pm

    Thank you for working with us during this very busy time to ensure a more secure and productive environment for everyone. In previous broadcasts, Partners IS announced changes impacting access to email when off of the Partners Network that would go into effect on October 31, 2017. These changes are no longer scheduled for this date. In the future, all access to Partners email will require that you confirm your identity with Secure Login (or 2-factor authentication, 2-FA) if you’re not logged in to the Partners network. Partners IS and Information Security are continuing development of a solution that will allow Secure Login when utilizing Apple’s native Mail client in addition to the Microsoft Outlook 2016 client. Please visit the Knowledge Base for more information regarding email client options, recommendations and instructions. This chart also describes what to do when your account is moved to Exchange Online based on the type of email client you are using.

     

    green - services online

    Emergency Network Switch Replacement

    October 27, 2017 3:45 pm - 4:15 pm

    Network Engineering repaced a Network switch at the Datacenter on Friday, October 27, 2017 from 3:45-4:15p.m.

    All associated servers and shares were unavailable while this emergency work was conducted.

    Action Required
    If you are a customer of one of these systems, we strongly encourage you to check the status of your system. Check any transfers that you may have had running and restart the transfer if necessary.

    If you experience any issues with the MAD data storage service, please contact rcc@partners.org.

     

    yellow - pre-downtime, calls to action

    REDCap Email Issues

    October 24, 2017 3:12 pm

    REDCap (https://redcap.partners.org/redcap) experienced issues sending emails from the system from October 20th, 2017 at 11:00PM through today October 24th at 9:30AM. 

    This includes survey invitations, survey notifications, emails sent via the AutoNotify plugin, and standard requests submitted to EDC Support. 

    Survey invitations that were sent or scheduled to be sent during this timeframe were not processed until the issue was resolved this morning. At that point, any queued emails were sent out to the participants. 

    Users using Survey Notifications and/or the AutoNotify plugin are urged to review their recently submitted responses by running an export of their data or a custom report. We are not able to have those emails sent retroactively.

    And users who submitted standard REDCap requests such as project/token creation, moves to production, copies of projects should follow up with EDC Support if their requests haven't been processed by the end of tomorrow.

    We apologize for the inconvenience.

    If you have any concerns, please email edcsupport@partners.org

    yellow - pre-downtime, calls to action

    RFANFS Unscheduled Downtime

    October 23, 2017 4:30 pm - 5:30 pm

    RFANFS (rfanfs.research.partners.org) and all associated shares were unavailable from 4:30-5:30p.m.

    During this window, any applications and systems that rely on storage associated with this server was unable to connect to the server. 

    Impact
    RFANFS (rfanfs.research.partners.org) is the file server that provides linux-based nfs and Samba sharing for the RFA/RIS service. Technicians checked to reboot or remount storage any impacted systems managed by ERIS.

    Action Required
    If you are an owner of a systems that connects to RFANFS, we strongly encourage you to check the status of your system. If you find one unresponsive, reboot or remount the storage. If any issues persist, please contact rcc@partners.org and we'll address the problem.

    Please contact rcc@partners.org if you have any questions or concerns.

    green - services online

    DIPR Proxy and Subnet Unexpected Downtime - Service Now Restored

    October 21, 2017 8:00 am - 1:20 pm

    The ERIS DIPR proxy allowing incoming connections to many websites and servers experienced an outage Saturday, October 21, 2017 early AM. because of a security issue.  Service was restored Saturday, October 21, 2017, 1:20 PM.

    green - services online

    StudyTRAX Unexpected/Scheduled Downtime

    October 19, 2017 4:15 pm - 7:35 pm

    StudyTRAX (https://studytrax.partners.org/StudyTrax/) experienced an unexpected outage on Oct. 19 from 4:15PM-7:25PM ET due to a Partners HealthCare SQL server issue.

    Upgrades were initiated immediately after and completed by 7:35PM ET. Systems are back online.

    For an overview of the new release including training videos, please review:

    https://sciencetrax.atlassian.net/wiki/spaces/STX/pages/58851331/Version+3.57

    If you have any concerns about this downtime, please email edcsupport@partners.org

    yellow - pre-downtime, calls to action

    RFANFS Unscheduled Downtime

    October 3, 2017 9:15 am - 10:30 am

    RFANFS Unscheduled Downtime on Tuesday, October 3, 2017, from 9:15a.m. - 10:30a.m.

    RFANFS (rfanfs.research.partners.org) and all associated shares were unavailable for emergency maintenance. Any applications and systems that rely on storage associated with this server were offline. 

    Impact
    RFANFS (rfanfs.research.partners.org) is the file server that provides linux-based nfs and Samba sharing for the RFA/RIS service. Technicians will check and reboot or remount storage any impacted systems managed by ERIS.

    Action Required
    If you are an owner of a system that connects to RFANFS, we strongly encourage you to check the status of your system(s). If you find one unresponsive, reboot or remount the storage. If any issues persist, please contact rcc@partners.org and we'll address the problem.

    Please contact rcc@partners.org if you have any questions or concerns about this maintenance.

    green - services online

    List Manager (Lyris) Upgrade on October 15, 2017

    October 15, 2017 9:00 pm - 9:15 pm

    List Manager (Lyris) upgrade from 12.0a to the latest version, 12.1.17 completed successfully in fifteen minutes.
    The upgrade was scheduled for Sunday, October 15, 2017, from 9-9:30p.m. EDT. The system was back online at 9:15p.m. EDT.

    Applies to:
    https://researchlistadmin.partners.org 
    https://phslyris2.partners.org 
    https://researchlist.partners.org

    This upgrade was to improve system stability and provide critical security fixes. The release notes can be found in the Knowledge Base

    Please contact rcc@partners.org with any questions, concerns or issues with the upgrade.

    We created a discussion list for those who use the system regularly, to connect and collaborate.
    Subscribe:  http://researchlistweb.partners.org/list/w/super-admins/subscribe_super-admins.aspx

    green - services online

    REDCap Scheduled Downtime

    September 29, 2017 2:36 pm

    REDCap (https://redcap.partners.org/redcap) upgrades to v7.4.11 scheduled for Thursday October 5th at 6:30AM EST are complete. REDCap was offline from 6:30AM-7:25 EST.

    This upgrade will include a number of new features and bug fixes. These include:

    • New feature: Custom Record Status Dashboards - Users can build and save custom versions of the Record Status Dashboard to customize the dashboard to their liking.
    • New feature: Better device management for the REDCap Mobile App – The Mobile App page in a project now contains better methods for keeping track of the activity of the mobile app used on many devices at a time for a single project.
    • New feature: Response Limit for surveys - Users may set a response limit for any given survey to prevent respondents from starting the survey once a set number of responses have been collected. Note: It can be set so that the response count included either completed responses only or both partial and completed responses. Users may also set custom text to be displayed to respondents on the survey page when the response limit has been reached.
    • New feature: Time Limit for Survey Completion – Users may set the amount of time (in days, hours, and/or minutes) that each respondent has to complete a given survey based on when they were initially sent the survey invitation. Note: This feature excludes public survey links. When enabled, a new column is displayed on the Participant List where it denotes if a participant’s survey link has expired and also displays the expiration time if you hover over the icon. If the icon is clicked, the user can permanently override the link expiration time by setting it further in the future (to give the respondent more time), or else to expire the link sooner (or even immediately).
    • Improvement - If a record has any survey invitations that are scheduled to be sent in the next 7 days, it will display a button above the table on the Record Home Page. The button will note how many upcoming invites are scheduled for the current record in the 7 days, and when clicked, it will display a table of the send time and survey title for the next 7 days worth of scheduled invites.

    Full release notes available here.

    If you have any concerns about REDCap being offline at this time or any questions about these new features, please email edcsupport@partners.org

    Pages