Data Processing, Archiving and Distributing of ALOS/PALSAR and ALOS-2/PALSAR-2
JAXA Supercomputer System Annual Report April 2018-March 2019
Report Number: R18ER0100
Subject Category: Space Technology
- Responsible Representative: Shin-ichi Sobue, ALOS-2 Project, Space Technology Directorate 1
- Contact Information: Osamu Ochiai(ochiai.osamu@jaxa.jp)
- Members: Hidetoshi Hayasaka, Akiko Otomo, Takashi Goto, Osamu Ochiai, Takashi Asama, Keiko Ishii, Hidenori Sakamoto, Fumi Ohgushi, Masanori Doutsu, Satoru Matsuda, Risako Dan, Atsushi Shimizu, Takashi Ikeda, Nobuhiro Muramoto, Keigo Yoshino, Koji Sakurai, Kouji Hagiwara, Daisuke Tokko, Tadahiro Yamamoto, Takuto Yokoi, Emi Satake
Abstract
Process bulk of ALOS/PALSAR and ALOS-2/PALSAR-2 data to Analysis Ready Data (ARD) and make the ARD available to users.
Reference URL
Please refer to ‘JAXA | Advanced Land Observing Satellite-2 "DAICHI-2" (ALOS-2)‘.
Reasons for using JSS2
In order for enhancing availability of JAXA’s Earth observation data as Open and Free, it is necessary to process and archive vast amoung of the ALOS/PALSAR and the ALOS-2/PALSAR-2 data to Analysis Ready Data (ARD) and make them available to users as quick as possible.
Achievements of the Year
Based on the feasibility study conducted in JFY 2017, in JFY 2018 ALOS/PALSAR Level 0 data (700TB in total) was sent from Tsukuba Space Center to JSS-2 at Chofu. In JSS-2 at Chofu, Level1.1 and Level 2.2 processing software as well as a Sftp API for external users to access to these data were implemented in the JSS-2. A feasibility study for ALOS-2/PALSAR-2 bulk processing was also conducted for effective and low cost implementation. In JFY 2019, bulk processing of ALOS/PALSAR L1.1 and L2.2 will be executed throughout 2019 year end. It is also expected to implement ALOS-2/PALSAR-2 bulk processing system based on the feasibility study conducted in JFY 2018.
Publications
N/A
Usage of JSS2
Computational Information
- Process Parallelization Methods: core parallelization by jxsub
- Thread Parallelization Methods: pthread, boost::thread
- Number of Processes: 1 – 10
- Elapsed Time per Case: 20 Minute(s)
Resources Used
Fraction of Usage in Total Resources*1(%): 0.07
Details
Please refer to System Configuration of JSS2 for the system configuration and major specifications of JSS2.
System Name | Amount of Core Time(core x hours) | Fraction of Usage*2(%) |
---|---|---|
SORA-MA | 0.00 | 0.00 |
SORA-PP | 10,631.80 | 0.08 |
SORA-LM | 0.00 | 0.00 |
SORA-TPP | 0.00 | 0.00 |
File System Name | Storage Assigned(GiB) | Fraction of Usage*2(%) |
---|---|---|
/home | 435.51 | 0.45 |
/data | 52,865.37 | 0.93 |
/ltmp | 41,341.16 | 3.54 |
Archiver Name | Storage Used(TiB) | Fraction of Usage*2(%) |
---|---|---|
J-SPACE | 0.67 | 0.02 |
*1: Fraction of Usage in Total Resources: Weighted average of three resource types (Computing, File System, and Archiver).
*2: Fraction of Usage:Percentage of usage relative to each resource used in one year.
JAXA Supercomputer System Annual Report April 2018-March 2019