本文へ移動

サイトナビゲーションへ移動

検索ボックスへ移動

サイドバーへ移動

ここは、本文エリアの先頭です。

Data Processing, Archiving and Distributing of ALOS/PALSAR and ALOS-2/PALSAR-2

JAXA Supercomputer System Annual Report April 2018-March 2019

Report Number: R18ER0100

Subject Category: Space Technology

PDF available here

  • Responsible Representative: Shin-ichi Sobue, ALOS-2 Project, Space Technology Directorate 1
  • Contact Information: Osamu Ochiai(ochiai.osamu@jaxa.jp)
  • Members: Hidetoshi Hayasaka, Akiko Otomo, Takashi Goto, Osamu Ochiai, Takashi Asama, Keiko Ishii, Hidenori Sakamoto, Fumi Ohgushi, Masanori Doutsu, Satoru Matsuda, Risako Dan, Atsushi Shimizu, Takashi Ikeda, Nobuhiro Muramoto, Keigo Yoshino, Koji Sakurai, Kouji Hagiwara, Daisuke Tokko, Tadahiro Yamamoto, Takuto Yokoi, Emi Satake

Abstract

Process bulk of ALOS/PALSAR and ALOS-2/PALSAR-2 data to Analysis Ready Data (ARD) and make the ARD available to users.

Reference URL

Please refer to ‘JAXA | Advanced Land Observing Satellite-2 "DAICHI-2" (ALOS-2)‘.

Reasons for using JSS2

In order for enhancing availability of JAXA’s Earth observation data as Open and Free, it is necessary to process and archive vast amoung of the ALOS/PALSAR and the ALOS-2/PALSAR-2 data to Analysis Ready Data (ARD) and make them available to users as quick as possible.

Achievements of the Year

Based on the feasibility study conducted in JFY 2017, in JFY 2018 ALOS/PALSAR Level 0 data (700TB in total) was sent from Tsukuba Space Center to JSS-2 at Chofu. In JSS-2 at Chofu, Level1.1 and Level 2.2 processing software as well as a Sftp API for external users to access to these data were implemented in the JSS-2. A feasibility study for ALOS-2/PALSAR-2 bulk processing was also conducted for effective and low cost implementation. In JFY 2019, bulk processing of ALOS/PALSAR L1.1 and L2.2 will be executed throughout 2019 year end. It is also expected to implement ALOS-2/PALSAR-2 bulk processing system based on the feasibility study conducted in JFY 2018.

Annual Reoprt Figures for 2018

Fig.1: ALOS/PALSAR Level1.1 data processed by JSS-2

 

Annual Reoprt Figures for 2018

Fig.2: ALOS/PALSAR Level2.2 data processed by JSS-2

 

Annual Reoprt Figures for 2018

Fig.3: ALOS/PALSAR porcessing software overview

 

Annual Reoprt Figures for 2018

Fig.4: ALOS/PALSAR bulk processing system overview

 

Publications

N/A

Usage of JSS2

Computational Information

  • Process Parallelization Methods: core parallelization by jxsub
  • Thread Parallelization Methods: pthread, boost::thread
  • Number of Processes: 1 – 10
  • Elapsed Time per Case: 20 Minute(s)

Resources Used

 

Fraction of Usage in Total Resources*1(%): 0.07

 

Details

Please refer to System Configuration of JSS2 for the system configuration and major specifications of JSS2.

Computational Resources
System Name Amount of Core Time
(core x hours)
Fraction of Usage*2(%)
SORA-MA 0.00 0.00
SORA-PP 10,631.80 0.08
SORA-LM 0.00 0.00
SORA-TPP 0.00 0.00

 

File System Resources
File System Name Storage Assigned
(GiB)
Fraction of Usage*2(%)
/home 435.51 0.45
/data 52,865.37 0.93
/ltmp 41,341.16 3.54

 

Archiver Resources
Archiver Name Storage Used
(TiB)
Fraction of Usage*2(%)
J-SPACE 0.67 0.02

*1: Fraction of Usage in Total Resources: Weighted average of three resource types (Computing, File System, and Archiver).

*2: Fraction of Usage:Percentage of usage relative to each resource used in one year.

JAXA Supercomputer System Annual Report April 2018-March 2019