MAD Data Storage service is back online. The cluster became unstable and required node reboots to restore service.
If you continue to experience any difficulty connecting to your MAD data storage, please contact rcc@partners.org.
HPCWIN has provided many years of service and will retire, coinciding with the end-of-support from Microsoft for Windows Server 2003. If you have a HPCWIN account currently, please plan on migrating to HPCWIN3.
The replacement service, HPCWIN3, is currently available to anyone interested in testing this new server. Request a HPCWIN3 account by completing the sign-up form at https://rc.partners.org/windows-analysis-server-account-request. HPCWIN3 has 32 CPU Cores and 3320 GB of memory running Windows Server 2012.
We will be contacting users who have not yet migrated to schedule that process. After the retirement of HPCWIN, you will no longer be able to login to HPCWIN, but you can request access to your data.
HPCWIN2 is not affected. Visit the website for an overview of the Windows Analysis Server Service.
In order to address lingering performance issues experienced by administrators of the IS Service Desk (http://www.partners.org/isservicedesk), PHS IS Operations performed a reboot of the servers beginning 5:15PM. There was an anticipated 30 minute period (5:15pm – 5:45pm).
View the IS Communications Broadcast online: http://atu.partners.org/ISCommunicationArchives.aspx?msgid=715
Updates to the operating system are planned for the ERISOne Linux Cluster. The provisional date set for this change is Sunday July 26th.
Operating system updates are unlikely to change the way jobs on the cluster run, however we recommend testing your applications and providing us feedback prior to Monday July 13th. A group of compute nodes that have the updates applied are available today for testing, for full details see the Knowledge Base article:
https://rc.partners.org/kb/computational-resources/linux-cluster/using-applications?article=1061
Further notification will be posted before updates are applied generally to all compute nodes.
The ERISOne cluster reopened at 2p.m. on Monday, June 29, 2015. erisone.partners.org SSH access was restored around 3p.m., and permissions issues accessing group folders on erisonefs.partners.org were resolved by 8p.m. on Monday, June 29, 2015.
Systems Affected
Maintenance Details
In order to ensure premium supportability, security and performance, we utilized this month's maintenance window to perform essential maintenance on the Panasas Storage Servers. On Sunday, June 28, 2015 at 8a.m. EDT, logins to the ERISOne cluster were disabled and the affected data folders were unavailable.
This maintenance is essential for the upgrading of critical storage. For the affected groups, any running jobs were paused at 8am, Sunday 6/28/2015, and resumed after the maintenance completed on Monday, June 29 at 2p.m. EDT. We highly recommend that affected lab groups avoid submitting jobs that may span the maintenance window as there is a small risk some may not resume successfully. For the full list of systems and folders affected, see the June 28, 2015 maintenance notifcation.
Please email hpcsupport@partners.org if you have any questions or concerns about this scheduled downtime.
The Lyris List Manager Mailing List System, https://researchlist.partners.org, is online and fully operational.
The Administrator Interface for the Lyris List Manager Mailing List System, https://researchlist.partners.org, was unaccessible on Chrome, FireFox & Internet Explorer browsers, when accessing the URL from the Partners network on Wednesday, May 13 from 11:30a.m. to 10p.m.
Messages delivered from email clients (i.e. Outlook) were not affected.
Contact rcc@partners.org with any questions or concerns.
In order to keep the system running efficiently, MAD space and inode usage need to be optimized across accounts. Beginning August 15, 2015, a new account policy will limit the amount of inodes consumed on the MAD system. Read more about best practices in the MAD User Guide. This is a reminder that MAD is designed as an archival tier system and file sizes should be kept as large as possible before uploading. Each file or folder object stored on MAD creates an inode, or index node.
Check out your current MAD space and inode usage at http://mad.research.partners.org/usage/; this report is updated hourly. MAD performs most efficiently when each file is over one megabyte in size on average, so that a maximum of 1024 inodes per gigabyte of space is consumed. Accounts consuming more than 1024 inodes/GB are asked to consolidate files into .tar or .zip archives, or move data to a more appropriate service. For assistance with tuning workflows to make better use of MAD, please email rcc@partners.org.
Due to a large volume of emails being sent from REDCap yesterday, a backlog was created which delayed the sending of survey invitations and system requests (request new projects, moves to production, change requests).
The delay was addressed this morning and as of 10:55AM EDT, all queued emails were sent and delay resolved.
We are working with the Network Security team to optimize our email configuration. Please allow an extra day for replies to service requests. We apologize for the inconvenience.
If you have any questions, please email edcsupport@partners.org
The portal https://myapps.partners.org page and menus received facelifts on Wednesday, May 6, 2015. This change includes a new web interface called StoreFront which will provide you with the ability to “pin” your favorite applications on the desktop. As of May 6, 2-factor authentification will also be required to access https://myapps.partners.org.
When you log in, you will see your red apple Macgateway icon on the main/favorites page, as well as links on the Macgateway page “pinned” to this area. You can run your applications from either the Macgateway page or from those pinned links.
These links are also available via the lefthand flyout menu activated by the “+”. See the Partners Citrix Storefront Coming for "MY CITRIX APPS" Announcement for additional details.
Partners HealthCare: Scheduled Downtime
REDCap (https://redcap.partners.org/redcap) upgrades to v5.9.18 were completed Tuesday, Apr. 21. REDCap was offline from 8:00 - 8:41 p.m. EST.
This upgrade is for bug fixes only, no new features. Full release notes available.
If you have any concerns about REDCap being offline at this time, please email edcsupport@partners.org
Partners Research Computing - LimeSurvey required unscheduled maintenance on April 17, 11:40 a.m. The systems needed to be rebooted and downtime lasted 10 minutes
RFA (Research File Area) was unavailable on Friday April 17, between 11 p.m. and 12 p.m. due to an urgent windows patch needing to be installed in order to thwart a recently discovered exploit.
During this time frame, connections could not be made to RFA storage. If you have any questions, please notify rcc@partners.org
REDCap (https://redcap.partners.org/redcap) required infrastructure updates on Thursday, Apr. 16th. Systems were offline from 3:00 a.m. - 8:08 a.m. EST.
The production REDCap database was migrated from MySQL 5.0/mysql.dipr.partners.org to MySQL 5.6/mysql3.dipr.partners.org. This is an interim solution to alleviate performance issues during shared DB maintenance. End-state plans for the platform will eventually be a clustered solution using CentOS7 HA clustering.
For more information, please contact edcsupport@partners.org or view the REDCap Alert Email Archive
Monthly Information Systems Maintenance (ISM) Applies To: All Users
Planned system maintenance and testing was performed by IS Operations teams. This routine maintenance reduces the risk of unscheduled outages on our computer network and to the Internet.
Impact to systems and applications
View the IS Broadcast Archive for additional details. We appreciate your patience while the work is completed. Please contact your IS Service Desk if you have any questions.
On Thursday, April 9th, 2015 from 10 - 12 p.m. EDT, maintenance will be performed on the RFA (Research File Area) storage system, but there will be no interruption to service.
Firmware software will be updated to ensure premium supportability, security and performance. An additional notice will be sent after maintenance has completed.
The RFA (Research File Area) storage system was offline for a brief system reboot on Monday, March 30, 2015 at 10 p.m. EDT. During the reboot, you will be disconnected from your RFA for approximately 30 minutes.
This downtime restarted a windows service that was hung and prevented the creation or modification of existing RFAs.
Please contact rcc@partners.org with any questions or concerns about the RFA storage service.
Data Center Maintenance affecting the ERISOne cluster and related computational resources completed successfully on Sunday 3/29 at 1 p.m. The environment underwent some minor disruptions during the power shutdown but all issues have been identified and are being resolved.
Please notify hpcsupport@partners.org if you are having continuing problems related to the Data Center maintenance.
Visit the KnowledgeBase for details about this scheduled maintenance event. http://rc.partners.org/kbase?cat_id=45&art_id=602
RedHat and CentOS issued OpenSSL updates to address multiple vulnerabilities. ERIS proxy and all current ERIS CentOS builds have been patched. Please restart any services that rely on OpenSSL for encryption (that might be Apache, Tomcat, JBoss, LDAP, etc).
DIPR VM users with custom builds (such as ubuntu, debian or other non-standard builds) will need to be patched by you or your system administrator.
More information regarding the OpenSSL updates can be found: https://www.us-cert.gov/ncas/current-activity/2015/03/19/OpenSSL-Patches-Multiple-Vulnerabilities
Please let us know if you have any questions or concerns by emailing rcc@partners.org.
Apple has released important software updates that address the security vulnerability known as “FREAK”. This exploit impacts encryption of all Apple products. Members of our Apple community are strongly encouraged to update all your devices to the latest operating system.
Prior to updating, ensure you backup your device and connect to wired power and internet if available.
Apple supports three versions of Mac OS X (10.8 Mountain Lion, 10.9 Mavericks, and 10.10 Yosemite). If you are running an older OS, please please contact your IS Service Desk for assistance upgrading your Mac.
Thank you for keeping our community safe & secure.
StudyTRAX v3.4 upgrades were completed Monday, March 16 at 5:00 - 6:40 p.m. EDT.
Login: https://studytrax.partners.org/StudyTrax/
New Release Info: http://www.sciencetrax.com/support/new-release/
If you have any concerns about this scheduled downtime, please email edcsupport@partners.org
