Welcome to Aalto, researchers. Aalto has excellent resources for you, but it can be quite hard to know of them all. These pages will provide a good overview of IT services for researchers for you (focused on computation and data-intensive work, including experimental work).
These aren’t generic IT instructions - ITS has an introduction for staff somewhere (but apparently not online). There is also a handy list of research-focused services provided which compliments this.
Aalto service units¶
Understanding all the Aalto services can be quite confusing. Here are some of the key players:
- Department IT: Only a few departments (mainly in SCI) have their own IT staff. Others have people such as laboratory managers which may be able to provide some useful advice. Known links: CS, NBE, PHYS, Math.
- Science-IT: Overlaps with SCI department IT groups. They run the Triton cluster and support scientific computing. Their services may be used throughout the entire university, but support is organized from the departments which fund them. The core Science-IT departments are CS, NBE, and PHYS. Science-IT runs a weekly SciComp garage, where we provide hands on support for anything related to scientific computing. This site (scicomp.aalto.fi) is the main home, but there is also an formal site.
- Aalto IT Services (ITS): Provides central IT infrastructure. They have a “Services for Research” group, but it is less specialized than Science-IT. ITS may be the first place to contact if not in the School of Science. Their infrastructure is used in all schools including SCI, and the base on which everyone builds. Their instructions are on aalto.fi, but most importantly the already-mentioned IT Services for Research page. Contact via servicedesk.
- Aalto Research Services: Administrative-type support. Provides support for grantwriting, innovation and commercialization, sponsored projects, legal services for research, and research infrastructures. (In 2019 a separate “innovation services” split from the previous “research and innovation services”).
- CSC is the Finnish academic computing center (and more). They provide a lot of basic infrastructure you use without knowing it, as well as computing and data services to researchers (all for free). `research.csc.fi <csc_>`_
Also, currently Aalto has information scattered on websites everywhere:
- aalto.fi is the normal homepage, but doesn’t have much practical information for researchers. As of late 2018, information from inside and into is supposed to move here. The new site is well known for being hard to use (sorry, we can’t do anything about that). This site is “not designed to have a logical structure and instead, you are expected to search for information” (actual quote). Some pages get more information if you log in, and there is no indication of which ones. In general, unless you know what you are looking for, don’t expect to find anything here without extensive work.
- inside.aalto.fi is the former typical “official” staff documentation area, but now gone since 2019 with all information moved to aalto.fi. It wasn’t in search engines, but once you found a page it wasn’t easy to find other information.
- into.aalto.fi is the student official information. It used to contain a lot of duplicate information to inside but was public, so people would end up there.
- wiki.aalto.fi is obviously the Aalto wiki space. Anyone can make a space here, and many departments’ internal sites are here. Searching can randomly find useful information. Most sites aren’t publically searchable.
- scicomp.aalto.fi is where you are now. Scicomp was started by the Science-IT team from the Triton (HPC cluster) documentation, and scicomp is slowly taking over from our departments’ research IT instructions. Now it is our general guidance to researchers and the best place to find information on research and scientific computing - as opposed to general “staff computing” you find other places.
Aalto provides computers to it’s employees, obviously. Wherther it is an Aalto wide managed system or standalone depends on your department policies. If it’s standalone, you are on your own. If managed, login is through your Aalto account. You can get laptop or desktop, and Linux, Mac, or Windows.
Desktops are connected directly to the wired networks and are typically preferred by researchers using serious data or computation. Linux desktops have fast and automatic access to all of the university data storage systems, including Triton and department storage. They also have a wide variety of scientific software already available (and somewhat similar to Triton). We have some limited instructions and pointers to the main instructions for mac and windows computers.
Managed laptops are usable in and out of the Aalto networks.
On both managed desktops and laptops you can become a “primary user” which allows you to install needed software that is found from the official repositories. Additionally, in some cases, Workstation Administrator (wa.) account can be given which close to normal root/Administrator account with some limitations. The “primary user” is widely accepted and recommended by Aalto ITS to all users while wa. accounts are regulated by the department policies or Aalto ITS.
Having a valid Aalto account you have two primary options: workstations and Triton. The Aalto workstations have basic scientific software installed. From the workstations, you can use the HTCondor distributed computing framework.
Most demanding computing at Aalto is performed on Triton, the Aalto high performance computing cluster. It is a fairly standard medium-sized cluster, and it’s main advantage is the close integration into the Aalto environment: it shares Aalto accounts, its data storage (2PB) is also available on workstations, and has local support. If you need dedicated resources, you can purchase them and they can be managed by Science IT team as part of Triton so that you get dedicated resources and can easily scale to the full power of Triton. Triton is part of the Finnish Grid and Cloud Infrastructure. Triton is the largest publically known computing cluster in Finland after the CSC clusters. Triton provides a web-based interface via JupyterHub.
CSC (the Finnish IT Center for Science) is a government-owned organization which provides a lot of services, most notably huge HPC clusters, data, and IT infrastructure services to the academic sector. All of their services are free to the academic community (paid directly by the state of Finland). They also coordinate the Finnish Grid and Cloud Infrastructure. They have the largest known clusters in Finland.
Data management isn’t just storage: if data is just put somewhere, you get a massive mess and data isn’t usable in even 5 years. Funders now require “data management plans”. Thus data management is not just a hot topic, it’s an important one. We have a whole section on data, and also there are higher level guides from Aalto. If you just want to get something done, you should start with our Aalto-specific guideline for Science-IT data storage (used in CS, NBE, PHYS) - if you follow our plan, you will be doing better than most people. If you have specific questions, there is an official service email address you can use (see the Aalto pages), or you can ask the Science-IT team.
Aalto has many data storage options, most free. In general, you should put your data in some centralized location shared with your group: if you keep it only on your own systems, the data dies when you leave. We manage data by projects: a group of people with shared access and a leader. Groups provide flexibility, sharing, and long-term management (so that you don’t lose or forget about data every time someone leaves). You should request as many projects as you need depending on how fine-grained you need access control, and each can have its own members and quota. You can read about the storage locations available and storage service policy.
Triton has 2PB of non-backed up data storage on the high-performance Lustre filesystem. This is used for large active computation purposes. The Triton nodes have an incredible bandwidth to this and it is very fast and parallel. This is mounted by default at Science-IT departments, and can be by default in other departments too.
Aalto provides “work” and “teamwork” centralized filesystems which are large, backed up, snapshotted, shared: everything you may want. Within the Science-IT departments, Science-IT and department IT manages it and provides access. For other schools/departments, both are provided by Aalto ITS but you will have to figure out your school’s policies yourself. It’s possible to hook this storage into whatever else you need over the network. (In general, “work” is organized by the Aalto hierarchy, while “teamwork” is flatter. If you consider yourself mainly Aalto staff who fits in the hierarchy, work is probably better. If you consider yourself a research who collaborates with whoever, teamwork is better.) Teamwork instructions
CSC provides both high-performance Lustre filesystems (like Triton) and archive systems. `CSC research portal <csc_>`_.
In our data management section, we provide many more links to long-term data repositories, archival, and so on. The fairdata.fi project is state-supported and has a lot more information on data. They also provide some data storage focused on safety and longer-term storage (like IDA), though they are not very used at Aalto because we provide such good services locally.
Triton and Aalto Linux workstations come with a lot of scientific software installed, with in the Lmod system. Triton generally has more. If you need something, it can be worth asking us first to install it for everyone.
If you are the primary user of a workstation, you can install Ubuntu packages yourself (and if you aren’t, you should ask to be marked as primary user). If you use Triton or are in a Science-IT department, it can be worth asking Science-IT about software you need - we are experts in this and working to simplify the mess that scientific software is. Windows workstations can have things automatically installed, check the windows page.
Triton and Aalto workstations have the central software available, currently for laptops you are on your own except for some standard stuff.
On Triton and Linux workstations, type
module spider $name to
search for available software. We are working to unify the software
stack available on Triton and Aalto workstations so that they have all
the same stuff.
CSC also has a lot of software. Some is on CSC computers, some is exported to Triton.
Starting a project¶
Each time you start a project, it’s worth putting a few minutes into planning so that you create a good base (and don’t end up with chaos in a few years). We don’t mean some grant, we mean a line of work with a common theme, data, etc.
- Think about how you’ll manage data. It’s always easy to just start working, but it can be worth getting all project members on the same page about where data will be stored and what you want to happen to it in the end. Having a very short thing written will also help a lot to get newcomers started. The “practical DMP” section here can help a lot - try filling out that A4 page to consider the big sections.
- Request a data group (see above) if you don’t already have a shared
storage location. This will keep all of your data together, in the same
place. As people join, you can easily give them access. When
people leave, their work isn’t lost.
- If you already have a data group that is suitable (similar members), you can use that. But there’s no limit to the number of projects, so think about if it’s better to keep things apart earlier.
- Mail your department IT support and request a group. Give the info requested at the bottom of data outline page.
- In the same message, request the different data storage locations, e.g. scratch, project, archive. Quotas can always be increased later.
Of course you want to get straight to research. However, we come from a wide range of backgrounds and we’ve noticed that missing basic skills (computer as a tool) can be a research bottleneck. We have constructed a multi-level training plan so that you can find the right courses for your needs. These courses are selected by researchers for researchers, so we make sure that everything is relevant to you.
Check our upcoming training page for a list of upcoming courses. If you do anything computational or code-based at all, you should consider the twice-yearly CodeRefinery workshops (announced on our page). If you have a Triton account or do high-performance computing or intensive computing or data-related tasks, you should come to the Summer (3 days) or Winter (1 day) kickstart, which teaches you the basics of Triton and HPC usage (we say it is “required” if you have a Triton account).
Remember to keep the IT Services for Research page close close at hand!
Research is usually collaborative, but sometimes you can feel isolated - either because you are lost in a crowd, or far away from your colleagues. Academic courses don’t teach you everything you need to be good at scientific computing - put some effort into working together with, learning from, and teaching your colleagues and you will get much further.
There are some good cheatsheets which our team maintains. They are somewhat sepcialized, but useful in the right places.
It can be hard to find your way around Aalto, the official campus maps and directions are known for being confusing confusing. Try UsefulAaltoMap instead.