本文へ移動

サイトナビゲーションへ移動

検索ボックスへ移動

サイドバーへ移動

ここは、本文エリアの先頭です。

Utilization of JSS2 for AMSR-E higher level data processing

JAXA Supercomputer System Annual Report April 2016-March 2017

Report Number: R16E0094

  • Responsible Representative: Masaaki Mokuno(GCOM Project Team, Space Technology Directorate I)
  • Contact Information: Kazuyoshi Nakamura(nakamura.kazuyoshi@jaxa.jp)
  • Members: Susumu Saitoh, Kazuyoshi Nakamura, Yuji Taniguchi, Masaya Torii, Tadahiro Yamamoto, Koki Ishimaru, Sachiko Kawase, Daichi Obinata, Yasuhiro Kawashima, Kentaro Koyama, Shun Ito, Kazuki Ideura, Junichi Okubo
  • Subject Category: Space(Satellite utilization)

Abstract

We will reprocess and provide AMSR-E high level product and AMSR2 high level product with the same algorithm (including improved algorithms). And expedite the provision of products to users.

Goal

AMSR-E/AMSR2 estimates various geophysical parameters by measuring radio waves in the weak microwave band radiated from the Earth’s surface and the atmosphere with multiple frequencies and multiple polarizations.

Geophysical parameters include water vapor, cloud liquid water, precipitation, sea surface temperature, sea surface wind speed, sea ice concentration, snow water equivalent, and soil moisture.

The long-term geophysical record will play an important role in climate change monitoring and will provide valuable information for understanding the Earth’s climate system, including water and energy circulation.

By reprocessing the AMSR-E product in the same format as AMSR2 which is succeeding sensor, we provide a long-term data set useful for users.

Objective

In this fiscal year, we will build a processing environment for AMSR-E and AMSR2 higher level products on JSS2, and reprocessing is executed with the same algorithm. In some products, improved algorithms are applied to improve product accuracy.

Also, shortening reprocessing time will realize to provide products more quickly.

References and Links

N/A

Use of the Supercomputer

We will use JSS2 as a computer resource when reprocessing the AMSR-E/AMSR2 high level product and will reprocess it in a short period of time.

Necessity of the Supercomputer

By using JSS2 with a large scalability processing environment and executing processing of enormous scenes in parallel, it becomes possible to provide products to users more quickly.

Achievements of the Year

In this fiscal year, we have constructed a reprocessing environment for high level products shown in Table 1. And, we reprocessed product that observation period two years worth. The generated products will be released sequentially.

Reprocessing of all the products for one month was executed in parallel (64 parallel execution). As a result, AMSR-E was able to complete processing about 7 hours and AMSR2 in about 11 hours.

In addition, the high level algorithm potential bug was found in this algorithm transition activities, which conducts the improvement of algorithm.

Annual Reoprt Figures for 2016

Table 1 : constructed environments

 

Publications

N/A

Computational Information

  • Parallelization Methods: Serial
  • Process Parallelization Methods: n/a
  • Thread Parallelization Methods: n/a
  • Number of Processes: 64
  • Number of Threads per Process: 1
  • Number of Nodes Used: 6
  • Elapsed Time per Case (Hours): 0.0008-0.0014
  • Number of Cases: 41528

Resources Used

 

Total Amount of Virtual Cost(Yen): 439,991

 

Breakdown List by Resources

Computational Resources
System Name Amount of Core Time(core x hours) Virtual Cost(Yen)
SORA-MA 0.00 0
SORA-PP 22,149.38 189,111
SORA-LM 0.00 0
SORA-TPP 0.00 0

 

SORA-FS File System Resources
File System Name Storage assigned(GiB) Virtual Cost(Yen)
/home 225.03 2,122
/data 9,879.43 93,193
/ltmp 16,276.05 153,532

 

J-SPACE Archiving System Resources
Archiving System Name Storage used(TiB) Virtual Cost(Yen)
J-SPACE 0.66 2,032

Note: Virtual Cost=amount of cost, using the unit price list of JAXA Facility Utilization program(2016)

JAXA Supercomputer System Annual Report April 2016-March 2017