Utilization of JSS2 for AMSR-E higher level data processing
JAXA Supercomputer System Annual Report April 2016-March 2017
Report Number: R16E0094
- Responsible Representative: Masaaki Mokuno(GCOM Project Team, Space Technology Directorate I)
- Contact Information: Kazuyoshi Nakamura(nakamura.kazuyoshi@jaxa.jp)
- Members: Susumu Saitoh, Kazuyoshi Nakamura, Yuji Taniguchi, Masaya Torii, Tadahiro Yamamoto, Koki Ishimaru, Sachiko Kawase, Daichi Obinata, Yasuhiro Kawashima, Kentaro Koyama, Shun Ito, Kazuki Ideura, Junichi Okubo
- Subject Category: Space(Satellite utilization)
Abstract
We will reprocess and provide AMSR-E high level product and AMSR2 high level product with the same algorithm (including improved algorithms). And expedite the provision of products to users.
Goal
AMSR-E/AMSR2 estimates various geophysical parameters by measuring radio waves in the weak microwave band radiated from the Earth’s surface and the atmosphere with multiple frequencies and multiple polarizations.
Geophysical parameters include water vapor, cloud liquid water, precipitation, sea surface temperature, sea surface wind speed, sea ice concentration, snow water equivalent, and soil moisture.
The long-term geophysical record will play an important role in climate change monitoring and will provide valuable information for understanding the Earth’s climate system, including water and energy circulation.
By reprocessing the AMSR-E product in the same format as AMSR2 which is succeeding sensor, we provide a long-term data set useful for users.
Objective
In this fiscal year, we will build a processing environment for AMSR-E and AMSR2 higher level products on JSS2, and reprocessing is executed with the same algorithm. In some products, improved algorithms are applied to improve product accuracy.
Also, shortening reprocessing time will realize to provide products more quickly.
References and Links
N/A
Use of the Supercomputer
We will use JSS2 as a computer resource when reprocessing the AMSR-E/AMSR2 high level product and will reprocess it in a short period of time.
Necessity of the Supercomputer
By using JSS2 with a large scalability processing environment and executing processing of enormous scenes in parallel, it becomes possible to provide products to users more quickly.
Achievements of the Year
In this fiscal year, we have constructed a reprocessing environment for high level products shown in Table 1. And, we reprocessed product that observation period two years worth. The generated products will be released sequentially.
Reprocessing of all the products for one month was executed in parallel (64 parallel execution). As a result, AMSR-E was able to complete processing about 7 hours and AMSR2 in about 11 hours.
In addition, the high level algorithm potential bug was found in this algorithm transition activities, which conducts the improvement of algorithm.
Publications
N/A
Computational Information
- Parallelization Methods: Serial
- Process Parallelization Methods: n/a
- Thread Parallelization Methods: n/a
- Number of Processes: 64
- Number of Threads per Process: 1
- Number of Nodes Used: 6
- Elapsed Time per Case (Hours): 0.0008-0.0014
- Number of Cases: 41528
Resources Used
Total Amount of Virtual Cost(Yen): 439,991
Breakdown List by Resources
System Name | Amount of Core Time(core x hours) | Virtual Cost(Yen) |
---|---|---|
SORA-MA | 0.00 | 0 |
SORA-PP | 22,149.38 | 189,111 |
SORA-LM | 0.00 | 0 |
SORA-TPP | 0.00 | 0 |
File System Name | Storage assigned(GiB) | Virtual Cost(Yen) |
---|---|---|
/home | 225.03 | 2,122 |
/data | 9,879.43 | 93,193 |
/ltmp | 16,276.05 | 153,532 |
Archiving System Name | Storage used(TiB) | Virtual Cost(Yen) |
---|---|---|
J-SPACE | 0.66 | 2,032 |
Note: Virtual Cost=amount of cost, using the unit price list of JAXA Facility Utilization program(2016)
JAXA Supercomputer System Annual Report April 2016-March 2017