Note
Go to the end to download the full example code.
Reading datasets#
In this example, we show the use of the generic read method to create dataset
either from local or remote files.
First we need to import the spectrochempy API package
from pathlib import Path
import spectrochempy as scp
Import dataset from local files#
Read a IR data recorded in Omnic format (.spg extension).
We just pass the file name as parameter.
if dataset is not None:
_ = dataset.plot(style="paper")

When using read, we can pass filename as a str or a pathlib.Path object.
If the supplied argument is a directory, then the whole directory is read at once.
By default, the different files will be merged along the first dimension (y).
However, for this to work, the second dimension (x) must be compatible (same size)
or else a WARNING appears. To avoid the warning and get individual spectra, you can
set merge to False . This test-data directory may also contain historical
trusted native .scp archives, which require explicit legacy opt-in.
dataset_list = scp.read("irdata", merge=False, allow_unsafe_legacy=True)
print(dataset_list)
[NDDataset: [float64] a.u. (shape: (y:19, x:3112)), NDDataset: [float64] a.u. (shape: (y:55, x:5549)), NDDataset: [float64] unitless (shape: (y:1, x:3736))]
to get full details on the parameters that can be used, look at the API documentation:
spectrochempy.read .
Import dataset from remote files#
To download and read file from remote server you can use urls.
try:
dataset_list = scp.read("http://www.eigenvector.com/data/Corn/corn.mat")
except FileNotFoundError:
dataset_list = None
print("Eigenvector corn dataset not reachable; skipping remote import examples.")
else:
# %%
# In this case the matlab data contains 7 arrays that have been automatically
# transformed to ``NDDataset`` .
for nd in dataset_list:
print(f"{nd.name} : {nd.shape}")
# %%
# The `eigenvector.com <eigenvector.com>`__ website contains the same data in a
# compressed (zipped) format:
# `corn.mat_.zip <https://eigenvector.com/wp-content/uploads/2019/06/corn.mat_.zip>`__ .
# This can also be used by the ``read`` method.
dataset_list = scp.read(
"https://eigenvector.com/wp-content/uploads/2019/06/corn.mat_.zip"
)
print(dataset_list)
# %%
# Plot each of the datasets
_ = dataset_list[-1].plot()
_ = dataset_list[-2].plot()
_ = dataset_list[-3].plot()
_ = dataset_list[-4].plot()
NDDataset_73805163 : (240, 700)
m5nbs : (3, 700)
NDDataset_738051ed : (8, 700)
propvals : (80, 4)
[NDDataset: [float64] unitless (shape: (y:240, x:700)), NDDataset: [float64] unitless (shape: (y:3, x:700)), NDDataset: [float64] unitless (shape: (y:8, x:700)), NDDataset: [float64] unitless (shape: (y:80, x:4))]
Uncomment the following line to display all figures when running the script directly with Python.
# scp.show()
Total running time of the script: (0 minutes 1.778 seconds)



