You are here
Intersect’s NSW-based supercomputer 'Orange' replaced McLaren in early 2013, continuing a tradition of naming for great Australian wine growing regions.
The SGI 34+ TFlop distributed memory cluster provide a greater than 25-fold increase of compute power and a fivefold increase of disk capacity on the previous system, McLaren.
Important announcement for all Orange hpc.Time users
In February 2017 arrangements to transition supercomputing capacity from Orange.intersect.org.au to Raijin.nci.org.au under an agreement that had been in negotiation with our partners, the National Computational Infrastructure was announced. Intersect Australia's renown hpc.Time team expert advice, friendly service, training, support and flexibility will remain and be extended by the breadth and depth of NCI backing.
The FAQs below explain the rationale, timetable and steps as we worked through the transition together.
April 2017: Update Summary
Farewell to Orange, and welcome to Raijin!
In March Intersect and NCI completed transitioning all research projects from Orange to Raijin. From April onwards, Intersect will make available over 8.5 million NCI Raijin compute hours per quarter.
All data has been copied from the Intersect Australia eResearch Nexus to the National Computational Infrastructure. Orange.intersect.org.au is fully decommissioned and uninstalled.
Raijin resource allocations for Q2 beginning 1 April 2017 are determined; you should have the resources needed to run your jobs for the quarter.
Intersect will run the next standard mid-term adjustment for all projects from 15th April as usual. Apart from rebalancing this will also provide opportunities for project addition in case of new researcher interest.
A full Intersect resource allocation round (RAR) will be scheduled in 2017 Q4 in keeping with previous years. Though separate, this will be coordinated with NCI’s National Computational Merit Allocation Scheme (NCMAS)
User home and project data are now available in the Raijin Lustre filesystem. Check out how to access them here.
There is no change to help and support arrangements. Please continue to make requests using the normal process; that is simply email firstname.lastname@example.org or visit help.intersect.org.au. The hpc.Time team will escalate to NCI User Support should this be required.
Below you’ll find technical information about the transition, including how to access data, the differences between Orange and Raijin, NCI conditions of use, contact information and scheduled maintenance.
Intersect and NCI are committed to easy, productive and effective supercomputing supported by deeply specialised HPC expertise through our joint teams and resources. We hope you’ll enjoy using Raijin.
Orange / Raijin transition information
Information About NCI and Raijin
- NCI Conditions of Use
- Mancini - User and Project Registration
- Raijin Documentation and User Guides
- Resource Allocations
- Workflows on Raijin
For users who have issues accessing or using Raijin, particularly first time users, the Intersect HPC transition team is providing targeted migration support for 1 month after the migration is complete; we expect this will be needed until the end of April 2017.
General supercomputing support will continue on an ongoing basis. Please email email@example.com or reach out to HPC Specialist Dr. Joachim.Mai@intersect.org.au. Users can also contact their local Intersect eResearch Analyst.
Intersect supports members and customers and administers project resources and allocations, and there are no changes to these arrangements. However there may be times you need to contact NCI directly.
NCI also operates an expert support desk service during normal business hours: 8:30am-5:30pm Monday-Friday. Users can lodge an NCI support request by sending email to firstname.lastname@example.org, or via the online support portal at https://help.nci.org.au (login required.) Support requests received outside of normal working hours are addressed as soon as possible on the next business day.
NCI User support is managed by the NCI User Services team, which operates the support desk service, and a consulting service for users on questions of code efficiency and optimisation, algorithms, and computational workflows. Members of the user support team are Ph.D.-qualified computational scientists, and can provide advice on algorithms and workflows in their area(s) of specialisation.
Frequently Asked Questions
1. Why is this happening?
We communicated in December last year that Orange.intersect.org.au was nearing the end of its working life and plans were being considered to transition to higher performing replacement technology early this year via ARC LIEF grant LE160100002, a successful grant application coordinated by Intersect with lead CI The University of Sydney.
The original intent of the LIEF grant was to make a capital investment in new generation HPC hardware, essentially updating Orange with current technology. It became clear during planning consultation in March 2016 that the consensus CI position was that aggregation at this quantum of investment scale is less relevant today and that greater computing leverage would be possible through pooling with NCI. This thinking was validated in subsequent consultation with Member DVCsR and CIOs.
Once NCI capacity was confirmed via the NCRIS Agility Funding announcements in late August, Intersect and NCI broadly agreed terms and the University of Sydney sought ARC consent to vary LE160100002 in September. In recent days, the ARC made a final determination to allow this to happen. Consequently, we are now executing a transition plan on an accelerated timescale to ensure all research projects and users are migrated with as little disruption as possible.
2. What's the timetable?
Standard job queue (250h walltime) closes for new jobs: 3rd March 2017 (midnight)
Standard job queue (200h walltime) closes for new jobs: 6th March 2017 (midnight)
Last jobs on Orange completed: 15th March 2017
Projects will be made read only: 16th March 2017
Users can copy latest results back to their local machines or Raijin until: 18th March 2017 (this date may be subject to change depending on progress)
Users locked out of Orange: 19th March 2017
Orange machine closed and shut down: 20th March 2017
Orange officially decommissioned: 31st March 2017
3. What do I do next?
If you have an existing account on Raijin we are working on providing additional SUs for the transition period and we will be in touch.
Users without accounts on Raijin will need to ensure that a correct mobile phone is associated in https://my.nci.org.au/mancini to allow passwords to be sent by SMS text message. We will get in touch to verify your account is operational.
You will be notified when your Raijin project is setup and available and data copied.
Getting started information about Raijin for Orange users is available here.
Detailed technical documentation about Raijin is available at NCI.
Orange features 100 cluster nodes with 1660 cores powered by the Intel® Xeon® E5-2600 processor series. It also includes 200TB local scratch disk space, 101TB of usable shared storage delivering 30+ TFlops.
The SGI HPC cluster is comprised of 13 large compute nodes each with dual Intel Xeon E5-2600 8-core processors, 256 GB memory, and 1x2TB SATA drives. System software provided includes SGI Management Center, SGI Performance Suite, PBS Pro Scheduler and SUSE® Linux Enterprise Server operating system. In addition, there are 90 small compute nodes each with dual Intel Xeon E5-2600 8-core processors, 64GB memory, 1x1TB SATA drives. The clusters are connected with QDR InfiniBand® Non-blocking Interconnect technology.
Dual administration nodes and a system console are also provided. Storage capabilities consist of an SGI NAS Storage Server with Panasas® ActiveStor™ 12 (high performance parallel file system) delivering 57TB usable storage.
Orange is funded through the Australian Research Council's Linkage Infrastructure, Equipment and Facilities (LIEF) scheme, (project number LE110100143). The LIEF grant, led by the University of Sydney’s Professor Leo Radom is supplemented by investments from the University of Sydney, UNSW, UTS, Macquarie University, the University of Newcastle, the University of Wollongong, Southern Cross University and the University of New England. The combined value of the capital investment is greater than $1million.
Intersect provides the on-going hosting facilities, management and support of HPC systems on behalf of the consortium of NSW universities. A rigorous procurement process was led by the University of Sydney.