TabNet Multi-Task Classifier

Multitask learning utilities for TabNet.

class pytorch_tabnet.multitask.TabNetMultiTaskClassifier(n_d: int = 8, n_a: int = 8, n_steps: int = 3, gamma: float = 1.3, cat_idxs: ~typing.List[int] = <factory>, cat_dims: ~typing.List[int] = <factory>, cat_emb_dim: int | ~typing.List[int] = 1, n_independent: int = 2, n_shared: int = 2, epsilon: float = 1e-15, momentum: float = 0.02, lambda_sparse: float = 0.001, seed: int = 0, clip_value: int = 1, verbose: int = 1, optimizer_fn: ~typing.Any = <class 'torch.optim.adam.Adam'>, optimizer_params: ~typing.Dict = <factory>, scheduler_fn: ~typing.Any = None, scheduler_params: ~typing.Dict = <factory>, mask_type: str = 'sparsemax', input_dim: int = None, output_dim: ~typing.List[int] = None, device_name: str = 'auto', n_shared_decoder: int = 1, n_indep_decoder: int = 1, grouped_features: ~typing.List[~typing.List[int]] = <factory>, compile_backend: str = '')[source]

Bases: TabSupervisedModel

TabNet model for multitask classification tasks.

compute_loss(y_pred: List[Tensor], y_true: Tensor, w: Tensor | None = None) → Tensor[source]

Compute the loss according to network output and targets.

Parameters:

  • y_pred (list of torch.Tensor) – Output of network for each task.

  • y_true (torch.Tensor) – Targets label encoded.

  • w (Optional[torch.Tensor]) – Optional sample weights.

Returns:

Output of loss function(s).

Return type:

torch.Tensor

output_dim: List[int] = None
predict(X: Tensor | ndarray) → List[ndarray][source]

Predict the most probable class for each task.

Parameters:

X (torch.Tensor, np.ndarray, or scipy.sparse.csr_matrix) – Input data.

Returns:

List of predictions for each task.

Return type:

List[np.ndarray]

predict_proba(X: Tensor | ndarray) → List[ndarray][source]

Predict class probabilities for each task.

Parameters:

X (torch.Tensor, np.ndarray, or scipy.sparse.csr_matrix) – Input data.

Returns:

List of probability predictions for each task.

Return type:

List[np.ndarray]

prepare_target(y: ndarray) → ndarray[source]

Map targets for each task using the target mappers.

Parameters:

y (np.ndarray) – Target array with shape (n_samples, n_tasks).

Returns:

Mapped target array.

Return type:

np.ndarray

set_fit_request(*, X_train: bool | None | str = '$UNCHANGED$', batch_size: bool | None | str = '$UNCHANGED$', callbacks: bool | None | str = '$UNCHANGED$', compute_importance: bool | None | str = '$UNCHANGED$', drop_last: bool | None | str = '$UNCHANGED$', eval_metric: bool | None | str = '$UNCHANGED$', eval_name: bool | None | str = '$UNCHANGED$', eval_set: bool | None | str = '$UNCHANGED$', from_unsupervised: bool | None | str = '$UNCHANGED$', loss_fn: bool | None | str = '$UNCHANGED$', max_epochs: bool | None | str = '$UNCHANGED$', num_workers: bool | None | str = '$UNCHANGED$', patience: bool | None | str = '$UNCHANGED$', pin_memory: bool | None | str = '$UNCHANGED$', virtual_batch_size: bool | None | str = '$UNCHANGED$', warm_start: bool | None | str = '$UNCHANGED$', weights: bool | None | str = '$UNCHANGED$', y_train: bool | None | str = '$UNCHANGED$') → TabNetMultiTaskClassifier

Request metadata passed to the fit method.

Note that this method is only relevant if enable_metadata_routing=True (see sklearn.set_config()). Please see User Guide on how the routing mechanism works.

The options for each parameter are:

  • True: metadata is requested, and passed to fit if provided. The request is ignored if metadata is not provided.

  • False: metadata is not requested and the meta-estimator will not pass it to fit.

  • None: metadata is not requested, and the meta-estimator will raise an error if the user provides it.

  • str: metadata should be passed to the meta-estimator with this given alias instead of the original name.

The default (sklearn.utils.metadata_routing.UNCHANGED) retains the existing request. This allows you to change the request for some parameters and not others.

Added in version 1.3.

Note

This method is only relevant if this estimator is used as a sub-estimator of a meta-estimator, e.g. used inside a Pipeline. Otherwise it has no effect.

Parameters:

  • X_train (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for X_train parameter in fit.

  • batch_size (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for batch_size parameter in fit.

  • callbacks (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for callbacks parameter in fit.

  • compute_importance (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for compute_importance parameter in fit.

  • drop_last (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for drop_last parameter in fit.

  • eval_metric (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for eval_metric parameter in fit.

  • eval_name (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for eval_name parameter in fit.

  • eval_set (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for eval_set parameter in fit.

  • from_unsupervised (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for from_unsupervised parameter in fit.

  • loss_fn (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for loss_fn parameter in fit.

  • max_epochs (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for max_epochs parameter in fit.

  • num_workers (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for num_workers parameter in fit.

  • patience (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for patience parameter in fit.

  • pin_memory (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for pin_memory parameter in fit.

  • virtual_batch_size (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for virtual_batch_size parameter in fit.

  • warm_start (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for warm_start parameter in fit.

  • weights (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for weights parameter in fit.

  • y_train (str, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED) – Metadata routing for y_train parameter in fit.

Returns:

self – The updated object.

Return type:

object

stack_batches(list_y_true: List[Tensor], list_y_score: List[List[Tensor]]) → Tuple[Tensor, List[Tensor]][source]

Stack batches of true and predicted values for all tasks.

Parameters:

  • list_y_true (List[torch.Tensor]) – List of true labels for each batch.

  • list_y_score (List[List[torch.Tensor]]) – List of predicted scores for each batch and task.

Returns:

Stacked true labels and list of stacked predicted scores per task.

Return type:

Tuple[torch.Tensor, List[torch.Tensor]]

update_fit_params(X_train: ndarray, y_train: ndarray, eval_set: List[Tuple[ndarray, ndarray]], weights: ndarray | None) → None[source]

Update fit parameters for multitask classification.

Parameters:

  • X_train (np.ndarray or scipy.sparse.csr_matrix) – Training data.

  • y_train (np.ndarray) – Training targets.

  • eval_set (list) – List of evaluation sets.

  • weights (np.ndarray or None) – Sample weights.

Example

from pytorch_tabnet.multitask import TabNetMultiTaskClassifier
import numpy as np
X = np.random.rand(100, 10)
y = np.random.randint(0, 2, size=(100, 2))  # 2 classification tasks
clf = TabNetMultiTaskClassifier()
clf.fit(X_train=X, y_train=y)
preds = clf.predict(X)