Stochastic simulation of large grids using free and public domain software

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)

Abstract

This paper proposes a tiled map procedure enabling sequential indicator simulation on grids consisting of several tens of millions of cells, without putting excessive memory requirements. Spatial continuity across map tiles is handled by conditioning adjacent tiles on their shared boundaries. Tiles across the area can be characterized by dissimilar models of spatial continuity (semi-variograms) thus relieving the requirement of a global stationarity decision. Additionally, the approach provides a simple mechanism for reseeding the pseudo random number generator. Implementation of the algorithm involved small modifications to a GSLIB program and Bash and awk scripting. The software was stable on several platforms, including 32-bit systems with a 4 Gb memory addressing limit. In an experiment we simulated 25 realizations of a 11,274×13,000 grid representing local uncertainty in the Dutch land cover at 25 m resolution. With the objective of mimicking the typical absence of well-distributed hard reference data, the simulations were only conditioned on local prior class probabilities and semi-variograms. Output was evaluated on the basis of reproduction of target levels of (1) cover type proportions, (2) overall class label accuracy and (3) spatially averaged local Shannon entropy. As expected, the realized statistics differed significantly from the target levels. However, the differences were consistent over the borders and the insides of map tiles. Thus, they did not result from the tiled map procedure but rather should be attributed to the used semi-conditional sequential indicator simulator. The current implementation can easily be adapted to accept other simulation algorithms
Original languageEnglish
Pages (from-to)828-836
JournalComputers and Geosciences
Volume31
Issue number7
DOIs
Publication statusPublished - 2005

Fingerprint

Tile
software
variogram
simulation
Data storage equipment
conditioning
entropy
simulator
Labels
land cover
Entropy
Simulators
Statistics
public domain
Open source software
experiment
Experiments
indicator

Keywords

  • soil acidification
  • uncertainty
  • program
  • reservoir
  • entropy

Cite this

@article{8e0be29fc1f14f19ab8d206f0845a350,
title = "Stochastic simulation of large grids using free and public domain software",
abstract = "This paper proposes a tiled map procedure enabling sequential indicator simulation on grids consisting of several tens of millions of cells, without putting excessive memory requirements. Spatial continuity across map tiles is handled by conditioning adjacent tiles on their shared boundaries. Tiles across the area can be characterized by dissimilar models of spatial continuity (semi-variograms) thus relieving the requirement of a global stationarity decision. Additionally, the approach provides a simple mechanism for reseeding the pseudo random number generator. Implementation of the algorithm involved small modifications to a GSLIB program and Bash and awk scripting. The software was stable on several platforms, including 32-bit systems with a 4 Gb memory addressing limit. In an experiment we simulated 25 realizations of a 11,274×13,000 grid representing local uncertainty in the Dutch land cover at 25 m resolution. With the objective of mimicking the typical absence of well-distributed hard reference data, the simulations were only conditioned on local prior class probabilities and semi-variograms. Output was evaluated on the basis of reproduction of target levels of (1) cover type proportions, (2) overall class label accuracy and (3) spatially averaged local Shannon entropy. As expected, the realized statistics differed significantly from the target levels. However, the differences were consistent over the borders and the insides of map tiles. Thus, they did not result from the tiled map procedure but rather should be attributed to the used semi-conditional sequential indicator simulator. The current implementation can easily be adapted to accept other simulation algorithms",
keywords = "soil acidification, uncertainty, program, reservoir, entropy",
author = "{de Bruin}, S. and {de Wit}, A.J.W.",
year = "2005",
doi = "10.1016/j.cageo.2005.01.017",
language = "English",
volume = "31",
pages = "828--836",
journal = "Computers and Geosciences",
issn = "0098-3004",
publisher = "Elsevier",
number = "7",

}

Stochastic simulation of large grids using free and public domain software. / de Bruin, S.; de Wit, A.J.W.

In: Computers and Geosciences, Vol. 31, No. 7, 2005, p. 828-836.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Stochastic simulation of large grids using free and public domain software

AU - de Bruin, S.

AU - de Wit, A.J.W.

PY - 2005

Y1 - 2005

N2 - This paper proposes a tiled map procedure enabling sequential indicator simulation on grids consisting of several tens of millions of cells, without putting excessive memory requirements. Spatial continuity across map tiles is handled by conditioning adjacent tiles on their shared boundaries. Tiles across the area can be characterized by dissimilar models of spatial continuity (semi-variograms) thus relieving the requirement of a global stationarity decision. Additionally, the approach provides a simple mechanism for reseeding the pseudo random number generator. Implementation of the algorithm involved small modifications to a GSLIB program and Bash and awk scripting. The software was stable on several platforms, including 32-bit systems with a 4 Gb memory addressing limit. In an experiment we simulated 25 realizations of a 11,274×13,000 grid representing local uncertainty in the Dutch land cover at 25 m resolution. With the objective of mimicking the typical absence of well-distributed hard reference data, the simulations were only conditioned on local prior class probabilities and semi-variograms. Output was evaluated on the basis of reproduction of target levels of (1) cover type proportions, (2) overall class label accuracy and (3) spatially averaged local Shannon entropy. As expected, the realized statistics differed significantly from the target levels. However, the differences were consistent over the borders and the insides of map tiles. Thus, they did not result from the tiled map procedure but rather should be attributed to the used semi-conditional sequential indicator simulator. The current implementation can easily be adapted to accept other simulation algorithms

AB - This paper proposes a tiled map procedure enabling sequential indicator simulation on grids consisting of several tens of millions of cells, without putting excessive memory requirements. Spatial continuity across map tiles is handled by conditioning adjacent tiles on their shared boundaries. Tiles across the area can be characterized by dissimilar models of spatial continuity (semi-variograms) thus relieving the requirement of a global stationarity decision. Additionally, the approach provides a simple mechanism for reseeding the pseudo random number generator. Implementation of the algorithm involved small modifications to a GSLIB program and Bash and awk scripting. The software was stable on several platforms, including 32-bit systems with a 4 Gb memory addressing limit. In an experiment we simulated 25 realizations of a 11,274×13,000 grid representing local uncertainty in the Dutch land cover at 25 m resolution. With the objective of mimicking the typical absence of well-distributed hard reference data, the simulations were only conditioned on local prior class probabilities and semi-variograms. Output was evaluated on the basis of reproduction of target levels of (1) cover type proportions, (2) overall class label accuracy and (3) spatially averaged local Shannon entropy. As expected, the realized statistics differed significantly from the target levels. However, the differences were consistent over the borders and the insides of map tiles. Thus, they did not result from the tiled map procedure but rather should be attributed to the used semi-conditional sequential indicator simulator. The current implementation can easily be adapted to accept other simulation algorithms

KW - soil acidification

KW - uncertainty

KW - program

KW - reservoir

KW - entropy

U2 - 10.1016/j.cageo.2005.01.017

DO - 10.1016/j.cageo.2005.01.017

M3 - Article

VL - 31

SP - 828

EP - 836

JO - Computers and Geosciences

JF - Computers and Geosciences

SN - 0098-3004

IS - 7

ER -