Close this window

Email Announcement Archive

[Users] NERSC Weekly Email, Week of January 11, 2021

Author: Rebecca Hartman-Baker <>
Date: 2021-01-11 16:29:50

# NERSC Weekly Email, Week of January 11, 2021 <a name="top"></a> # ## Contents ## - [Summary of Upcoming Events and Key Dates](#dates) ## [NERSC Status](#section1) ## - [NERSC Operations Continue, with Minimal Shelter-in-Place Impacts](#curtailment) ## [This Week's Events and Deadlines](#section2) ## - [IDEAS-ECP Webinar on the Extreme-Scale Scientific Software Stack (E4S) on Wednesday](#ecpwebinar) - [Martin Luther King, Jr. Day Holiday Next Monday; No Consulting or Account Support](#mlkday) ## [Updates at NERSC ](#section3) ## - [(NEW) Changes to Python Module Pip Behavior & Python PATH in New AY](#pip) - [Plan for the New Allocation Year, Beginning January 20, 2021](#newayplan) - [Large Memory Nodes on Cori and Spin Available to Users](#largemem) ## [Calls for Participation](#section4) ## ## [Upcoming Training Events ](#section5) ## ## [NERSC News ](#section6) ## - [No New "NERSC User News" Podcast this Week](#nopodcast) - [Come Work for NERSC!](#careers) - [Upcoming Outages](#outages) - [About this Email](#about) ## Summary of Upcoming Events and Key Dates <a name="dates"/></a> ## January 2021 Su Mo Tu We Th Fr Sa 1 2 3 4 5 6 7 8 9 10 11 12 *13* 14 15 16 13 Jan IDEAS-ECP Webinar [1] 17 *18* 19 *20* 21 22 23 18 Jan MLK Holiday [2] 20 Jan Cori Monthly Maint Window [3] 20 Jan AY 2021 Begins [4] 24 25 26 27 28 29 30 31 February 2021 Su Mo Tu We Th Fr Sa 1 2 3 4 5 6 7 8 9 10 11 12 13 14 *15* 16 *17* 18 19 20 15 Feb Presidents Day Holiday [5] 17 Feb Cori Monthly Maint Window [3] 21 22 23 24 25 26 27 28 March 2021 Su Mo Tu We Th Fr Sa 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 1. **January 13, 2021**: [IDEAS-ECP Monthly Webinar](#ecpwebinar) 2. **January 18, 2021**: [Martin Luther King Jr. Holiday](#mlkday) (No Consulting or Account Support) 3. **January 20 & February 17, 2021**: Cori Monthly Maintenance Window 4. **January 20, 2020**: [Allocation Year 2021 Begins](#newayplan) 5. **February 15, 2021**: Presidents Day Holiday (No Consulting or Account Support) 6. All times are **Pacific Time zone** - **Upcoming Planned Outage Dates** (see [Outages section](#outages) for more details) - **January 20:** Brief Iris update, all-day Cori maintenance - **Other Significant Dates** - **February 4-5, 2021**: [First International Symposium on Checkpointing for Supercomputing (SuperCheck21)](#ckpt) ([back to top](#top)) --- ## NERSC Status <a name="section1"/></a> ## ### NERSC Operations Continue, with Minimal Shelter-in-Place Impacts <a name="curtailment"/></a> Alameda County, California, where NERSC is located, remains under a shelter-in-place order. NERSC continues to remain open while following site-specific protection plans. We remain in operation as before, with the majority of NERSC staff working remotely for the foreseeable future, and only staff essential to operations onsite. You can continue to expect regular online consulting and account support but no telephone support. Trainings will continue to be held online, or postponed if online is infeasible. Regular maintenances on the systems will continue to be performed while minimizing onsite staff presence, which could result in longer downtimes than would occur under normal circumstances. Because onsite staffing is so minimal, we request that you continue to refrain from calling NERSC Operations except to report urgent system issues. For **current NERSC systems status**, please see the online [MOTD]( and [current known issues]( webpages. ([back to top](#top)) --- ## This Week's Events and Deadlines <a name="section2"/></a> ## ### IDEAS-ECP Webinar on the Extreme-Scale Scientific Software Stack (E4S) on Wednesday <a name="ecpwebinar"/></a> The next webinar in the [Best Practices for HPC Software Developers]( series is entitled "Extreme-Scale Scientific Software Stack (E4S)" and will take place this Wednesday, January 13, 2021, at 10:00 am Pacific time. This webinar, presented by Sameer Shende (University of Oregon) and David Honneger Rogers (Los Alamos National Laboratory), discusses the Extreme-Scale Scientific Software Stack (E4S), a curated, Spack-based, comprehensive and coherent software stack that will enable application developers to productively write highly parallel applications that can portably target diverse exascale architectures. There is no cost to attend, but registration is required. Please register [here]( ### Martin Luther King, Jr. Day Holiday Next Monday; No Consulting or Account Support <a name="mlkday"/></a> Consulting and account support are unavailable next Monday, January 18, due to the Berkeley Lab-observed Martin Luther King, Jr. Day holiday. Regular consulting and account support services will resume the next day. Operations staff are available for urgent machine-related queries via 1-800-66-NERSC, Option 1, at all times. ([back to top](#top)) --- ## Updates at NERSC <a name="section3"/></a> ## ### (NEW) Changes to Python Module Pip Behavior & Python PATH in New AY <a name="pip"/></a> At the allocation year (AY) rollover on January 20, 2021, NERSC will change the behavior of Python pip in the default Python module (python/3.8-anaconda-2020.11) and Python3 module (which is an alias to the default Python module) by prepending `PYTHONUSERBASE/bin` to `PATH`. No changes will be made to the legacy, non-default Python modules. Currently, `PYTHONUSERBASE`, the environment variable that controls the location of pip package installs, is set to `/global/homes/s/<your-user-name>/.local/cori/3.8-anaconda-2020.11` in the default Python module. `PYTHONUSERBASE/bin` is not currently added to `PATH`. **Effective AY 2021,** we will now prepend `PYTHONUSERBASE/bin` to `PATH` in the python and python3 modules. We are making this change to better align with standard provisioning practices. **What does this mean for you?** The binaries installed by some pip-installed packages will now be added to `PATH`. Users depending on the current structure of `PATH` need to adjust their code accordingly. **Note that Python users who use `conda init` will not be affected by this change as they are not using a Python module.** Please see [here]( for details. If you have questions or concerns, please open a ticket at <>. ### Plan for the New Allocation Year, Beginning January 20, 2021 <a name="newayplan"/></a> The new NERSC allocation year (AY) begins next Wednesday, January 20, 2021. Any new and continuing projects received notice in early December. Additional information was sent before the holidays to PIs and PI proxies of continuing projects on how to update your project's continuing user list and authorize the use of premium. **Please complete this task by the end of the week if at all possible.** There will be a few changes for AY 2021 centered around access and charging for the "premium" QOS. PIs will now be able to authorize only select users to charge to premium. In addition, high premium utilization (above 20% of a project's allocation) will be charged a higher premium rate (4x vs 2x the "regular" QOS cost). Much will remain the same, however. The base charge rates will not change for 2021, and the software default versions will not change from 2020 defaults. We anticipate that **software defaults may change later in the year** when we must perform an upgrade to Cori's operating system. The Perlmutter machine will come online in AY 2021. Users will not be charged for any utilization on Perlmutter in AY 2021. Perlmutter charging will begin in AY 2022. For more details about the AY transition, please see the [AY Transition Webpage]( ### Large Memory Nodes on Cori and Spin Available to Users <a name="largemem"/></a> The new [Cori Large Memory]( ("cmem") system, consisting of 20 nodes each with 2 TB memory and two 16-core 3.0 GHz AMD EPYC 7302 (Rome) processors and 3 TB local SSD disk, is available for use. Prospective users must apply for access via the [cmem access request form]( The nodes are available to all NERSC users upon approval. Projects performing COVID-19 related research or with strong scientific use cases that have a need for the nodes' architectural characteristics will be prioritized. Usage is charged at the Cori Haswell rate. If you are performing COVID-19 related research and require additional allocation to support your work, please indicate that on the form when you apply. The Spin container-based platform at NERSC was upgraded with a new cluster of large-memory nodes to support a broader range of services, including those with memory footprints as large as 1-2 TB, such as - epidemiological models used to study the SARS-CoV-2 virus, - large in-memory databases, - memory-intensive web applications. Though Spin is intended for persistent services rather than HPC workloads, the large-memory nodes in the new cluster are also well-equipped to satisfy bursts of computing and I/O demand from services, with 64 AMD EPYC cores each, SSD-based local storage, and SSD-cached attached storage. If you're interested in using these resources, please [contact NERSC]( with more details about your project. ([back to top](#top)) --- ## Calls for Participation <a name="section4"/></a> ## ([back to top](#top)) --- ## Upcoming Training Events <a name="section5"/></a> ## ([back to top](#top)) --- ## NERSC News <a name="section6"/></a> ## ### No New "NERSC User News" Podcast this Week <a name="nopodcast"/></a> There will be no new episode of the "NERSC User News" podcast this week. We encourage you to instead enjoy some of our most recent episodes and greatest hits: - [Software Support Policy]( In this interview with NERSC HPC Consultant Steve Leak, learn about the new NERSC software support policy: what it is, how it works, and its benefits for users and NERSC staff alike. - [NERSC Power Upgrade]( In this interview with Berkeley Lab Infrastructure Modernization Division's David Topete, learn about the power upgrade happening this weekend, the work that has to be done, and the steps taken to ensure the safety of the workers involved in the effort. - [Dynamic fan]( NERSC Energy Efficiency Engineer Norm Bourassa talks about how NERSC is saving energy with the dynamic fan settings on the Cori supercomputing cabinets, and what NERSC is doing to make the cabinets even more energy efficient. - [RAPIDS]( In this interview with NVIDIA RAPIDS senior engineer Nick Becker, learn about the RAPIDS library, how it can accelerate your data science, and how to use it. - [IO Middleware]( NERSC Principal Data Architect Quincey Koziol talks about IO Middleware: what it is, how you can benefit from using it in your code, and how it is evolving to support data-intensive computing and future supercomputing architectures. - [NERSC 2019 in Review and Looking Forward]( NERSC director Sudip Dosanjh reflects upon the accomplishments of NERSC and its users in 2019, and what he's looking forward to in 2020 at NERSC. - [Community File System]( NERSC Storage System Group staff Kristy Kallback-Rose, Greg Butler, and Ravi Cheema talk about the new Community File System and the migration timeline. - [Monitoring System Performance]( NERSC Computational Systems Group's Eric Roman discusses how NERSC monitors system performance, what we're doing with the data right now, and how we plan to use it in the future. - [The Superfacility Concept]( Join NERSC Data Science Engagement Group Lead Debbie Bard in a discussion about the concept of the superfacility: what it means, how facilities interact, and what NERSC and partner experimental facilities are doing to prepare for the future of data-intensive science. - [Optimizing I/O in Applications]( Listen to an I/O optimization success story in this interview with NERSC Data and Analytics Services Group's Jialin Liu. - [NESAP Postdocs]( Learn from NESAP postdoc Laurie Stephey what it's like working as a postdoc in the NESAP program at NERSC. The NERSC User News podcast, produced by the NERSC User Engagement Group, is available at <> and syndicated through iTunes, Google Play, Spotify, and more. Please give it a listen and let us know what you think, via a ticket at <>. ### Come Work for NERSC! <a name="careers"/></a> NERSC currently has several openings for postdocs, system administrators, and more! If you are looking for new opportunities, please consider the following openings: - [HPC Performance Engineer]( Enable new scientific advancements by enabling scientists to exploit cutting-edge computational science techniques in machine learning, data analysis, and/or simulation on NERSC's next supercomputer. - [NESAP for Data Postdoctoral Fellow]( Work in multidisciplinary teams to transition data-analysis codes to NERSC's new Perlmutter supercomputer and produce mission-relevant science that truly pushes the limits of high-end computing. - [NESAP for Simulations Postdoctoral Fellow]( Work in multidisciplinary teams to develop and optimize codes for the Perlmutter system and produce mission-relevant science that pushes the limits of high-performance computing. - [NESAP for Learning Postdoctoral Fellow]( Work in multidisciplinary teams to develop and implement cutting-edge machine learning/deep learning solutions in codes that will run on NERSC's new Perlmutter supercomputer and produce mission-relevant science that pushes the limits of AI on high-performance computing. - [Systems / DevOps Engineer]( Use your DevOps and system engineering skills to help build and manage systems that complement NERSC's supercomputing environment. (**Note:** We have received reports that the URLs for the jobs change without notice, so if you encounter a page indicating that a job is closed or not found, please check by navigating to <>, scrolling down to the 9th picture that says "All Jobs" and clicking on that. Then, under "Business," select "View More" and scroll down until you find the checkbox for "NE-NERSC" and select it.) We know that NERSC users can make great NERSC employees! We look forward to seeing your application. ### Upcoming Outages <a name="outages"/></a> - **Cori** - 01/20/21 07:00-20:00 PDT, Scheduled Maintenance - 02/17/21 07:00-20:00 PDT, Scheduled Maintenance Visit <> for latest status and outage information. ### About this Email <a name="about"/></a> You are receiving this email because you are the owner of an active account at NERSC. This mailing list is automatically populated with the email addresses associated with active NERSC accounts. In order to remove yourself from this mailing list, you must close your account, which can be done by emailing <> with your request. _______________________________________________ Users mailing list

Close this window