fusionlab.nn.components.QuantileDistributionModeling

class fusionlab.nn.components.QuantileDistributionModeling

Bases: Layer, NNLearner

QuantileDistributionModeling layer projects deterministic outputs into quantile predictions [1].

Depending on whether quantiles is specified, this layer:

• Returns (B, H, O) if quantiles is None.

• Returns (B, H, Q, O) otherwise, where Q is the number of quantiles.

\[\mathbf{Y}_q = \text{Dense}_q(\mathbf{X}), \forall q \in \text{quantiles}\]

Parameters:

• quantiles (list of float or str or None) – List of quantiles. If ‘auto’, defaults to [0.1, 0.5, 0.9]. If None, no extra quantile dimension is added.

• output_dim (int) – Output dimension per quantile or in the deterministic case.

Notes

This layer is often used after a decoder to provide probabilistic forecasts via quantile outputs.

call(`inputs`, training=False)

Projects inputs into desired quantile shape.

get_config()

Returns configuration dictionary.

from_config(`config`)

Instantiates from config.

Examples

>>> from fusionlab.nn.components import QuantileDistributionModeling
>>> import tensorflow as tf
>>> x = tf.random.normal((32, 10, 64))  # (B, H, O)
>>> # Instantiate with quantiles
>>> qdm = QuantileDistributionModeling([0.25, 0.5, 0.75], output_dim=1)
>>> # Forward pass => (B, H, Q, O) => (32, 10, 3, 1)
>>> y = qdm(x)

See also

MultiDecoder

Outputs multi-horizon predictions that can be further turned into quantiles.

AdaptiveQuantileLoss

Computes quantile losses for outputs generated by this layer.

References

[1]

Lim, B., & Zohren, S. (2021). “Time-series forecasting with deep learning: a survey.” Philosophical Transactions of the Royal Society A, 379(2194), 20200209.

__init__(quantiles, output_dim, **kwargs)

Initialize the QuantileDistributionModeling layer.

Parameters:

• quantiles (list of float or str or None) – If ‘auto’, defaults to [0.1, 0.5, 0.9]. If None, returns deterministic output.

• output_dim (int) – Output dimension for each quantile or the deterministic case.

Methods

__init__(quantiles, output_dim, **kwargs)	Initialize the QuantileDistributionModeling layer.
add_loss(loss)	Can be called inside of the call() method to add a scalar loss.
add_metric(*args, **kwargs)
add_variable(shape, initializer[, dtype, ...])	Add a weight variable to the layer.
add_weight([shape, initializer, dtype, ...])	Add a weight variable to the layer.
build(input_shape)
build_from_config(config)	Builds the layer's states with the supplied config dict.
call(inputs[, training])	Forward pass projecting to quantile outputs or deterministic outputs.
compute_mask(inputs, previous_mask)
compute_output_shape(*args, **kwargs)
compute_output_spec(*args, **kwargs)
count_params()	Count the total number of scalars composing the weights.
from_config(config)	Creates a new instance from the given config dict.
get_build_config()	Returns a dictionary with the layer's input shape.
get_config()	Configuration dictionary for layer serialization.
get_params([deep])	Get the parameters for this learner.
get_weights()	Return the values of layer.weights as a list of NumPy arrays.
help(**kwargs)
load(file_path[, format])	Load the learner's state from a specified file in the desired format.
load_own_variables(store)	Loads the state of the layer.
quantize(mode[, type_check, config])
quantized_build(input_shape, mode)
quantized_call(*args, **kwargs)
rematerialized_call(layer_call, *args, **kwargs)	Enable rematerialization dynamically for layer's call method.
save([file_path, format, overwrite, ...])	Save the learner's state to a specified file in the desired format.
save_own_variables(store)	Saves the state of the layer.
set_params(**params)	Set the parameters of this learner.
set_weights(weights)	Sets the values of layer.weights from a list of NumPy arrays.
stateless_call(trainable_variables, ...[, ...])	Call the layer without any side effects.
summary()	Provide a summary of the learner's parameters.
symbolic_call(*args, **kwargs)

Attributes

compute_dtype	The dtype of the computations performed by the layer.
dtype	Alias of layer.variable_dtype.
dtype_policy
input	Retrieves the input tensor(s) of a symbolic operation.
input_dtype	The dtype layer inputs should be converted to.
input_spec
losses	List of scalar losses from add_loss, regularizers and sublayers.
metrics	List of all metrics.
metrics_variables	List of all metric variables.
my_params
non_trainable_variables	List of all non-trainable layer state.
non_trainable_weights	List of all non-trainable weight variables of the layer.
output	Retrieves the output tensor(s) of a layer.
path	The path of the layer.
quantization_mode	The quantization mode of this layer, None if not quantized.
supports_masking	Whether this layer supports computing a mask using compute_mask.
trainable	Settable boolean, whether this layer should be trainable or not.
trainable_variables	List of all trainable layer state.
trainable_weights	List of all trainable weight variables of the layer.
variable_dtype	The dtype of the state (weights) of the layer.
variables	List of all layer state, including random seeds.
weights	List of all weight variables of the layer.

__init__(quantiles, output_dim, **kwargs)

Initialize the QuantileDistributionModeling layer.

Parameters:

• quantiles (list of float or str or None) – If ‘auto’, defaults to [0.1, 0.5, 0.9]. If None, returns deterministic output.

• output_dim (int) – Output dimension for each quantile or the deterministic case.

call(inputs, training=False)

Forward pass projecting to quantile outputs or deterministic outputs.

Parameters:

• inputs (tf.Tensor) – A 3D tensor of shape (B, H, O).

• training (bool, optional) – Unused in this layer. Defaults to False.

Returns:

• If quantiles is None: (B, H, O)

• Else: (B, H, Q, O)

Return type:

tf.Tensor

get_config()

Configuration dictionary for layer serialization.

Returns:

Contains ‘quantiles’ and ‘output_dim’.

Return type:

dict

classmethod from_config(config)

Creates a new instance from the given config dict.

Parameters:

config (dict) – Configuration dictionary with ‘quantiles’ and ‘output_dim’.

Returns:

A new instance.

Return type:

QuantileDistributionModeling

help(**kwargs)

my_params = QuantileDistributionModeling(quantiles, output_dim)