Overview¶
Soil water content is an essential component of the hydrologic cycle.
Soil water content, also known as soil moisture, refers to the water between the soil surface and the groundwater level in the unsaturated zone. This water is replenished by precipitation, irrigation, or capillary rise from deeper layers, and depleted by percolation, soil evaporation, and plant transpiration.
Planet's Soil Water Content (SWC) product is based on the microwave radiation naturally emitted by the Earth. This passive microwave radiation is related to the water content in the soil and provides a direct measurement of water in the top layer of the soil. It is not sensitive to cloud cover and, therefore, allows for consistent, frequent, and global coverage.
Planet's patented algorithm enhances the spatial resolution of the passive microwave observations and the physical-based Land Parameter Retrieval Model retrieves the soil water content. Optical imagery from Sentinel-2 is used to further improve the spatial resolution.
Planet provides SWC data at 100 and 1000 meter resolutions. With an archive spanning over 20 years, the data is consistent across time and space, boasting a strong correlation with ground data and accurately reflecting weather patterns. It is a cost-effective and low-effort alternative for measuring soil water content with physical sensors, making it suitable for many use cases like agriculture, water management, and insurance.
Figure 1: Measurements of SWC near Ahlen, in North Rhine-Westphalia, Germany. The measurements of SWC of a single point are plotted over 5 years with the baseline climatology, showing how soild water content levels compare to the expected average for the area.
Product Specifications¶
Table 1: SWC 100 m product specification
Data Resource | SWC 100 m L band | SWC 100 m C band | SWC 100 m X band |
---|---|---|---|
Source ID | SWC-SMAP-L_V2.0_100 | SWC-AMSR2-C_V2.0_100 | SWC-AMSR2-X_V2.0_100 |
Satellites Used | AMSR-2, SMAP, Sentinel-2 | AMSR-2, Sentinel-2 | AMSR-2, Sentinel-2 |
Band | L band | C band | X band |
Version | 2.0 | 2.0 | 2.0 |
Unit | m³/m³ | m³/m³ | m³/m³ |
Sensing Depth1 | ~5 cm | ~2 cm | ~1 cm |
Pixel Size | 100x100 m | 100x100 m | 100x100 m |
Temporal Resolution | 0° latitude: 137 to 183 observations per year 40° latitude: 183 to 228 observations per year |
0° latitude: 205 to 228 observations per year 40° latitude: 274 to 292 observations per year |
0° latitude: 205 to 228 observations per year 40° latitude: 274 to 292 observations per year |
Overpass Time | 6:00 AM local solar time | 01:30 AM local solar time | 01:30 AM local solar time |
Geographical Coverage | Global | Global | Global |
Data Availability | 2017-07-01 - Present Data Gaps: 2019-06-19 to 2019-07-24 2022-08-05 to 2022-09-24 2022-11-16 to 2022-11-18 |
2017-07-01 - Present | 2017-07-01 - Present |
NRT latency | ~12 hours after overpass of the satellite | ~12 hours after overpass of the satellite | ~12 hours after overpass of the satellite |
Archive latency | Within 30 days after creating a subscription | Within 30 days after creating a subscription | Within 30 days after creating a subscription |
Table 2: SWC 1000 m product specification
Data Resource | SWC 1000 m L band | SWC 1000 m C band | SWC 1000 m X band |
---|---|---|---|
Source ID | SWC-SMAP-L_V5.0_1000 | SWC-AMSR2-C_V5.0_1000 (2012 - present) SWC-AMSRE-C_V5.0_1000 (2002 - 2011) |
SWC-AMSR2-X_V5.0_1000 (2012 - present) SWC-AMSRE-X_V5.0_1000 (2002 - 2011) |
Version | 5.0 | 5.0 | 5.0 |
Unit | m³/m³ | m³/m³ | m³/m³ |
Sensing Depth1 | ~5 cm | ~2 cm | ~1 cm |
Pixel Size | 1000x1000 m | 1000x1000 m | 1000x1000 m |
Temporal Resolution | 0° latitude: 137 to 183 observations per year 40° latitude: 183 to 228 observations per year |
0° latitude: 205 to 228 observations per year 40° latitude: 274 to 292 observations per year |
0° latitude: 205 to 228 obs/year 40° latitude: 274 to 292 obs/year |
Overpass Time | 6:00 AM local solar time | 01:30 AM local solar time | 01:30 AM local solar time |
Geographical Coverage | Global | Global | Global |
Data Availability | 2015-04-01 - Present Data Gaps: 2019-06-19 to 2019-07-24 2022-08-05 to 2022-09-24 2022-11-16 to 2022-11-18 |
2002-06-15 - Present Data gap: 2011-10-04 to 2012-07-25 |
2002-06-15 - Present Data gap: 2011-10-04 to 2012-07-25 |
Satellites Used | AMSR-2, SMAP | AMSR-E, AMSR-2 | AMSR-E, AMSR-2 |
NRT latency | ~12 hours after overpass of the satellite | ~12 hours after overpass of the satellite | ~12 hours after overpass of the satellite |
Archive latency | Within 30 days after creating a subscription | Within 30 days after creating a subscription | Within 30 days after creating a subscription |
1 The sensing depth described in the table is an estimation of the average condition. Several studies (e.g. Schmugge et al., 1986; Wang et al., 1987; Owe et al., 1998) have shown that microwave-based soil water content penetration depth depends on the soil water content conditions and frequency. At 1.41 GHz the penetration depth varies from approximately 10 cm to 1 m for soil conditions ranging from saturated to dry, whereas at 10.7 GHz the penetration depth varies from less than a few mm to a little over 2 cm for similar conditions. Thus, the drier the soil, the deeper the sampling depth.
Asset Properties¶
The table below specifies the properties of the data assets that are delivered by the Planet Subscriptions API.
Table 3: Asset properties of SWC 100 m and SWC 1000 m data resources
Asset Name | Band Name | Unit | Type | Typical Range | No Data Value | Format |
---|---|---|---|---|---|---|
swc | Band 1 | m3/m3 | UINT16 | 0 - 1 | 65535 | GeoTIFF |
swc | Band 2 | m3/m3 | UINT16 | 0 - 1 | 65535 | GeoTIFF |
swc-qf | Band 1 | unitless | UINT16 | see tables 5 and 6 | 0 | GeoTIFF |
Methodology¶
Passive Microwaves and Downscaling Method¶
Planet's Soil Water Content data is derived from satellite sensors that measure passive microwave radiation. Passive microwave technology detects natural microwave emissions from the Earth's surface, which are sensitive to soil water content.
Using a patented algorithm2, we combine and downscale observations from multiple satellite constellation to a spatial resolution of 1000 m. We create footprints based on the footprint center, microwave frequency, incidence angle, azimuth angle, and footprint size, and then disaggregate them into equal interval ellipses using an internal Gaussian distribution. Within these ellipse-shaped footprints, the center contributes more to the observed values than the edges. By using fixed values for water bodies and filtering out influences such as radio frequency interference (RFI), we ensure accurate brightness temperatures.
2Patent US10643098, EP3469516B1: Method and system for improving the resolution of sensor data.
Enhancements Using Optical Data¶
The microwave observations are further downscaled to a spatial resolution of 100 meters based on the Normalized Difference Shortwave Infrared (NDSWIR) index. This index is constructed from Near-Infrared (NIR) and Shortwave Infrared (SWIR) bands of Sentinel-2, namely B08 (842 nm) and B11 (1610 nm).
Several studies (Lobell & Asner 2002, Fensholt and Sandholt 2003, Sadeghi et al. 2017, Yue et al. 2019) found that soil and plant water content significantly affect the reflection in the SWIR part of the spectrum. The NIR reflectance is influenced by the internal structure and dry matter content of leaves, but not by water content. By combining SWIR, which responds to water content, with NIR reflectance, we can more accurately retrieve water content from the reflectance data (Gao 1996, Ceccato et al. 2001).
We produce a daily NDSWIR composite using a backward Gaussian weighted distribution. This composite integrates into the downscaling framework by attributing the weight of a brightness temperature to each pixel within the footprint. The output format remains similar to that of the downscaling algorithm without NDSWIR input.
The Sentinel-2 preprocessing is performed in-house using Sen2Cor, fmask and S2Cloudless. Sen2Cor applies atmospheric, terrain, and cirrus correction to the L1C granule. The processing converts the input (L1C) from Top of the Atmosphere (TOA) to Bottom of the Atmosphere (BOA) reflectances. The preprocessing also produces a scene classification of four different classes for clouds (including cirrus) and six different classes for shadows, cloud shadows, vegetation, soils / deserts, water and snow. Two additional algorithms are also performed in-house: 1. Python FMASK produces a multiclass mask, which includes clouds, cloud shadow, snow (or high reflectance), and water; and 2. S2Cloudless produces a binary map which distinguishes between clouds and non-clouds.
Physical-based Land Parameter Retrieval Model¶
The downscaled high resolution microwave observations are converted to soil water content using the physical-based Land Parameter Retrieval Model (LPRM) (Owe et al. 2001; Owe et al. 2008; De Jeu et al. 2014, Van der Schalie et al., 2018, Van der Schalie et al., 2018).
The basis for the retrieval relies on the fact that thermal radiation in the microwave region is emitted by all natural surfaces as a function of temperature. The propagation of microwaves through the soil is then dependent on the soil dielectric constant, which has an almost linear relationship with soil water content. Microwave technology is the only remote sensing method that measures a direct response to the absolute amount of water in the soil, with a sensing depth ranging from millimeters for 37 GHz to tens of cm for 1.4 GHz. Vegetation also contributes to the microwave signal by absorbing, reflecting, and emitting radiation.
LPRM solves the radiative transfer equation at different frequencies and polarizations to retrieve soil water content and is currently the baseline algorithm for the ESA Climate Change Initiative (CCI) soil moisture products (Scanlon et al., 2021).
Input Data¶
Table 4: List of inputs for Soil Water Content production
Product | Description |
---|---|
Brightness Temperature L band | Soil Moisture Active Passive (SMAP) Level-1B Radiometer Half-Orbit Time-Ordered L band Brightness Temperatures, Version 5 (downloaded from NSIDC in HDF5 format). This Level-1B product provides calibrated estimates of time-ordered geolocated brightness temperatures at 1.41 GHz with a footprint size of 39x47 km. SMAP L band brightness temperatures are referenced to the Earth's surface with undesired and erroneous radiometric sources removed. Data has been available since April 2015 with a latency of 12 hours. Detailed information is available here. |
Brightness Temperature X band | Advanced Microwave Scanning Radiometer for EOS (AMSR-E) and Advanced Microwave Scanning Radiometer 2 (AMSR-2) Level-1B Radiometer X band Brightness Temperatures (downloaded from JAXA G-portal in HDF5 format). This Level-1B product provides calibrated estimates of geolocated brightness temperatures at 10.7 GHz with a footprint size of 24x42 km. Data has been available from July 2002 to October 2011 (AMSR-E) and from June 2012 (AMSR-2) up to now with a latency of 12 hours. Detailed information is available here |
Brightness Temperature C band | AMSR-E and AMSR-2 Level-1B Radiometer C band Brightness Temperatures (downloaded from JAXA G-portal in HDF5 format). This Level-1B product provides calibrated estimates of geolocated brightness temperatures at 6.9 GHz with a footprint size of 35x62 km. Data has been available from July 2002 to October 2011 (AMSR-E) and from June 2012 (AMSR-2) up to now with a latency of 12 hours. Detailed information is available here. |
Brightness Temperature Ka band | AMSR-E and AMSR-2 Level-1B Radiometer Ka band Brightness Temperatures (downloaded from JAXA G-portal in HDF5 format). This Level-1B product provides calibrated estimates of geolocated brightness temperatures at 36.5 GHz with a footprint size of 7x12 km. Data has been available from July 2002 to October 2011 (AMSR-E) and from June 2012 (AMSR-2) up to now with a latency of 12 hours. Detailed information is available here. |
Brightness Temperature W band | AMSR-E and AMSR-2 Level-1B Radiometer W band Brightness Temperatures (downloaded from JAXA G-portal in HDF5 format). This Level-1B product provides calibrated estimates of geolocated brightness temperatures at 89 GHz with a footprint size of 3x5 km. Data has been available from July 2002 to October 2011 (AMSR-E) and from June 2012 (AMSR-2) up to now with a latency of 12 hours. Detailed information is available here. |
Reflectances SWIR and NIR (for SWC 100 m only) | Sentinel-2 Level-1C reflectances (downloaded from Google Cloud or the Earth Observation Data Center based on availability) for the two bands: SWIR (shortwave-infrared around 1610 nm) and NIR (near-infrared around 842 nm). This product provides orthorectified (geometric ortho-correction taking into account a DEM) Top Of Atmosphere reflectance (more details here). The processing to retrieve level-2 (bottom of atmosphere) and cloud masking is performed in-house using Sen2Cor, fmask and S2Cloudless. Detailed information is available here. |
Digital Elevation Model | Digital elevation model (DEM) static map resampled at 100 m based on the Copernicus DEM GLO-90 product covering the full global landmass of the time frame of data acquisition (2011-2015). Detailed information is available in the link. |
Land Cover Map | Custom global land classification including permanent water bodies based on the Copernicus Global Surface Water Bodies product from PROBA-V. Detailed information is available here |
Soil Map | Soil property maps resampled at 100 m based on the SoilGrids product. SoilGrids was funded by the core funding of ISRIC with additional support from the EUH2020 CIRCASA project. Detailed information is available here, |
Data Quality¶
Uncertainty¶
The accuracy of soil water content retrievals from passive microwave observations and in particular the performance of the Land Parameter Retrieval Model has been described widely in the scientific literature: it has been compared to ground stations, hydrological models, and other satellite-derived products (e.g. Van der Schalie et al., 2021; Gruber et al., 2020; Gevaert et al., 2018).
The accuracy of the retrievals depends on the microwave frequency. L-band soil water content has the highest accuracy of approximately 0.04 m³/m³, which is comparable to the accuracy of ground sensors (e.g. see Ganjegunte et al., 2012). The accuracy of the C and X band based products is approximately 0.05 m³/m³. In addition, the accuracy is a direct function of the vegetation cover as demonstrated by Van der Schalie et al., 2018.
The X and C band based retrievals are most sensitive to the density of the vegetation cover and provide the most reliable values with short vegetation. L band retrievals perform well over the majority of land covers, with the exception of dense tropical rainforest.
Validation¶
We have evaluated our SWC products by comparing them to carefully picked ground data stations across various land cover types. The Pearson correlation coefficient varied between 0.53 and 0.92, indicating strong relations with ground truth data. Figure 2 showns an example of a comparison of SWC data compared to ground data.
You can read more about the results and how to perform a validation in this white paper.
Figure 2: Time series of the average of 9 stations of the RAAM network, the Netherlands.
Quality Flags¶
SWC products come with quality flag assets (*swc-qf.tif
) that provide quality metadata for each pixel using bitwise flags. Critical flags indicate unreliable data, with corresponding pixels set to the no data value. The replaced SWC value can be found in band 2 of the SWC asset (*swc.tif
). Non-critical flags indicate that the data can be used with caution, taking into account the flag description.
Critical and non-critical flags are described in the tables below. For more information on how to access the quality flag asset, check out subscribing to planetary variables.
Table 5: Non-critical flags
Bit | Flag layer | Description |
---|---|---|
1 | Dense vegetation | The retrieved soil water content is less reliable over dense vegetation cover. |
2 | Low soil water content | The retrieved soil water content is lower than the estimated wilting point. |
3 | High soil water content | The retrieved soil water content is higher than the estimated porosity. |
4 | Possible severe precipitation | Part of the footprints touch an area flagged as severe precipitation. |
5 | Possible RFI | Footprints are contaminated for less than 25% with Radio Frequency Interference (RFI). RFI occurs when human-made transmitters emit in the same frequencies and thus disrupt the radiometer measurements of the natural microwave emission. |
7 | Possible frozen soil | The soil may be frozen. These are pixels with a soil temperature between -10°C and 0°C. |
Table 6: Critical flags
Bit | Flag layer | Description |
---|---|---|
6 | Statistical outlier | The underlying footprint is considered a statistical outlier. |
8 | Frozen soil | The soil is frozen. Pixels with a soil temperature below -10°C. A conservative value of -10°C was chosen to avoid masking valid data. |
9 | Severe precipitation | Severe precipitation is detected. |
10 | Vegetation too dense | The vegetation cover is too dense for the algorithm to reliably retrieve soil water content. |
11 | No overpass | The satellite did not pass over. |
12 | RFI | Footprints are contaminated for more than 25% with Radio Frequency Interference (RFI). RFI occurs when human-made transmitters emit in the same frequencies and thus disrupt the radiometer measurements of the natural microwave emission. |
13 | Instrumental flaws | Unrealistic values due to instrumental flaws. If the brightness temperature at 36.5 GHz V produces values either over 400K or under 0.9 * the water temperature, the data is considered as unrealistic and is removed. |
14 | Out of valid range | Soil water content values are outside the valid range, meaning under 0 m3/m3 or above 1 m3/m3. |
15 | Open water | Soil water content is not defined over water. |
16 | Brightness temperature residuals too high | The LPRM model could not find a soil water content value that is consistent with all provided input data. |
Figure 3: An example of two quality flags for a region around Nantes, France. The image shows critical flags 'open water' and 'no overpass' overlaid on SWC 100 m.
Here is a Python script to convert a quality flag pixel value into a list of corresponding quality flags. Note that one pixel may have multiple flags applied to it.
# swc_quality_flags.py
import argparse
SWC_QUALITY_FLAGS = {
1: "Dense vegetation",
2: "Low soil water content",
3: "High soil water content",
4: "Possible severe precipitation",
5: "Possible RFI",
6: "Statistical outlier (critical flag)",
7: "Possible frozen soil",
8: "Frozen Soil (critical flag)",
9: "Severe precipitation (critical flag)",
10: "Vegetation too dense (critical flag)",
11: "No overpass (critical flag)",
12: "RFI (critical flag)",
13: "Instrumental flaws (critical flag)",
14: "Out of valid range (critical flag)",
15: "Open water (critical flag)",
16: "Brightness temperature residuals too high (critical flag)",
}
def convert_to_quality_flags(decimal_value: int) -> list[str]:
binary_string = format(decimal_value, "016b")
reversed_binary_string = binary_string[::-1]
return [
f"{i}. {SWC_QUALITY_FLAGS.get(i, "Unused flag")}"
for i, bit in enumerate(reversed_binary_string, start=1) if bit == "1"
]
if __name__ == "__main__":
parser = argparse.ArgumentParser(description="Convert a decimal value to quality flags.")
parser.add_argument("decimal_value", type=int, help="The decimal value to convert.")
args = parser.parse_args()
flags = convert_to_quality_flags(args.decimal_value)
print(*flags, sep="\n")
that you can call as follows, using value 32770
as example:
> python swc_quality_flags.py 32770
2. Low soil water content
16. Brightness temperature residuals too high (critical flag)
Other Limitations¶
The following are some key limitations that we have not flagged:
- SWC data should be considered unreliable over sloped terrain that is over 20 degrees. The microwave signal can be distorted by the angle of the slope, causing changes in the observed brightness temperature. This distortion leads to inaccuracies in the soil water content estimates because the algorithms assume a flat surface. Data usually shows up unrealistically dry.
- SWC data should be considered unreliable over urban areas. Human-made surfaces like concrete and asphalt have different microwave emissivity properties than natural soil. These surfaces can cause reflections and scattering of the microwave signal, leading to incorrect soil water content retrieval. Moreover, because urban areas have such a wide range of land cover types (asphalt, concrete, roofs, parks, gardens, etc) the average SWC value is not representative of any specific land cover type.
- Dynamic water bodies may cause unrealistic soil water content estimates. Water bodies influence the microwave observations and without proper mitigation they could result in unrealistic retrievals. Data around dynamic waterbodies can show up drier or wetter.
- Cloud cover hinders the optical observations by Sentinel-2 that are used for the SWC 100 m products. The downscaling can therefore only be updated when we obtain a cloud-free observation and the SWC data may suddenly increase or decrease after a long spell of no observations.
- False cloud/shadow detections may occur if surface conditions change very rapidly, during prolonged cloudiness, or over AOIs with significant terrain and shadowing. Significant effort has gone into developing automated techniques to differentiate between actual change and atmospheric contamination, but there may still be false detections.
Frequently Asked Questions¶
There are three different bands for soil water content. What is a 'band' and which one should I use?¶
We use passive microwave observations to measure soil water content. A microwave signal is a light signal with a frequency that is much lower than the frequency of visible light. The lower the frequency of the passive microwaves, the more they tell us about what happens below the ground. A “band” refers to the frequency band we use to measure SWC. The lowest frequency band we deliver is the L-band (1.4 GHz), which is measured by the SMAP satellite. This measurement shows the water content in the top 5 cm of the soil. Other frequencies we deliver are the C-band (6.9 GHz), which shows the water content in the top 2 cm, and X-band (10.7 GHz), showing the top cm of the soil. The X-band and C-band measurements come from the AMSR-2 satellite.
For most use cases, L-band measurements are the best choice: - They are representative of a deeper layer than the other bands. - Vegetation on top of the soil has a much lower impact on the signal than for other bands. - L-band observations are more sensitive to soil water content changes than the other bands: per unit change in soil water content, the microwave soil emission changes are stronger for L-band than for higher frequencies like C-band. This higher sensitivity leads to more accurate and precise SWC observations.
There are however some situations where the other bands are a better choice: - Sometimes, radio signals emitted from the Earth interfere with the soil water content signals. We call this effect “radio frequency interference” (RFI). We filter for RFI, but sometimes the filter does not filter out everything, leading to strange SWC values. When this happens in the L-band for a specific location, use X-band or C-band. - AMSR-2 provides the observations for X-band and C-band SWC. AMSR-2 data is available from 2012 onwards, and can be combined with data from its predecessor (AMSR-E) to compute long SWC time series, all the way back to 2002. When a customer wants to have a long time series, C-band and X-band data can go back to 2002. Our L-band product can provide SWC data from 2015 to present.
What is the difference between the SWC 100 m and 1000 m products?¶
Our SWC 1000 m product is based on our patented disaggregation method where we make optimum use of the overlapping satellite footprints to refine the resolution from 36 km tot 1 km. The SWC 100 m product also uses the NIR and SWIR band from Sentinel-2 to add more spatial constraints to our disaggregation method.
Why does the SWC 1000 m product show a higher correlation with in-situ measurements than the SWC 100 m product?¶
Sometimes, customers compare our SWC products with in-situ measurements and find that the SWC 1000 m products perform better than the SWC 100 m products. This can be explained by the method used to enhance the spatial resolution. The SWC 1000 m product uses passive microwave observations, and has a temporal resolution of about 2 days, depending on the microwave band used and the latitude.
As a result, the SWC 1000 m product sees a lot of the temporal variations in SWC which are also caught by the in-situ sensor. For the enhanced-resolution products, we combine the passive microwave observations with infrared observations from the Sentinel-2 satellite. The infrared observations have a repeat cycle of about 5 days, depending on the latitude, but they cannot be made on cloudy days. The infrared data tell us how the soil water content is spatially divided within the coarser SWC 1000 m product and thus can accurately tell us which fields are relatively wet or dry, compared to the environment. However, the lower temporal resolution of the infrared data can cause the correlation coefficient to drop compared to the SWC 1000 m product. The enhanced-resolution product does get updated every time a new passive microwave observation comes in, but the temporal changes that result from the infrequent infrared observations can cause a degradation in the correlation.
Therefore, when a customer is interested mostly in the temporal changes, often the 1km products are the best choice. When they are interested in the spatial variations, the enhanced-resolution product can tell which areas are relatively dry or wet, compared to the environment.
Is SWC a modeled product or an observation?¶
The brightness temperatures are direct observations by the satellite. These observations are used in a physical-based radiative transfer model to retrieve soil water content. However, considering the strong physical description of the radiative transfer model, scientists often refer passive microwave soil water content as satellite-observed.
Release notes¶
November 14, 2023 - SWC 1000 m V5.0 and SWC 100 m V2.0¶
New Features:
- Increased temporal resolution for L-band products
- Enhanced outlier detection capabilities
- Improved parameterization of the SWC retrieval model
- Refined water-body mask, enabling pixel size reduction from 1000m to 100m while maintaining consistent spatial support
- Updated quality flags for more accurate data assessment
Important notice
These new versions are not compatible with previous versions. Combining datasets from different versions may introduce offsets and scale discrepancies. We strongly advise against merging data from old and new versions.
We are continually working to improve our technical documentation and support. Please help by sharing your experience with us.