pyemma.coordinates.transform.TICA

class pyemma.coordinates.transform.TICA(lag, dim=-1, var_cutoff=0.95, kinetic_map=True, epsilon=1e-06, mean=None, stride=1, remove_mean=True)

Time-lagged independent component analysis (TICA)

__init__(lag, dim=-1, var_cutoff=0.95, kinetic_map=True, epsilon=1e-06, mean=None, stride=1, remove_mean=True)

Time-lagged independent component analysis (TICA) [1], [2], [3].

Parameters:
  • lag (int) – lag time
  • dim (int, optional, default -1) – Maximum number of significant independent components to use to reduce dimension of input data. -1 means all numerically available dimensions (see epsilon) will be used unless reduced by var_cutoff. Setting dim to a positive value is exclusive with var_cutoff.
  • var_cutoff (float in the range [0,1], optional, default 0.95) – Determines the number of output dimensions by including dimensions until their cumulative kinetic variance exceeds the fraction subspace_variance. var_cutoff=1.0 means all numerically available dimensions (see epsilon) will be used, unless set by dim. Setting var_cutoff smaller than 1.0 is exclusive with dim
  • kinetic_map (bool, optional, default True) – Eigenvectors will be scaled by eigenvalues. As a result, Euclidean distances in the transformed data approximate kinetic distances [4]. This is a good choice when the data is further processed by clustering.
  • epsilon (float) – eigenvalue norm cutoff. Eigenvalues of C0 with norms <= epsilon will be cut off. The remaining number of eigenvalues define the size of the output.
  • mean (ndarray, optional, default None) – This option is deprecated
  • remove_mean (bool, optional, default True) – remove mean during covariance estimation. Should not be turned off.

Notes

Given a sequence of multivariate data \(X_t\), computes the mean-free covariance and time-lagged covariance matrix:

\[\begin{split}C_0 &= (X_t - \mu)^T (X_t - \mu) \\ C_{\tau} &= (X_t - \mu)^T (X_{t + \tau} - \mu)\end{split}\]

and solves the eigenvalue problem

\[C_{\tau} r_i = C_0 \lambda_i(tau) r_i,\]

where \(r_i\) are the independent components and \(\lambda_i(tau)\) are their respective normalized time-autocorrelations. The eigenvalues are related to the relaxation timescale by

\[t_i(tau) = -\tau / \ln |\lambda_i|.\]

When used as a dimension reduction method, the input data is projected onto the dominant independent components.

References

[1](1, 2) Perez-Hernandez G, F Paul, T Giorgino, G De Fabritiis and F Noe. 2013. Identification of slow molecular order parameters for Markov model construction J. Chem. Phys. 139, 015102. doi:10.1063/1.4811489
[2](1, 2) Schwantes C, V S Pande. 2013. Improvements in Markov State Model Construction Reveal Many Non-Native Interactions in the Folding of NTL9 J. Chem. Theory. Comput. 9, 2000-2009. doi:10.1021/ct300878a
[3](1, 2) L. Molgedey and H. G. Schuster. 1994. Separation of a mixture of independent signals using time delayed correlations Phys. Rev. Lett. 72, 3634.
[4]Noe, F. and C. Clementi. 2015. Kinetic distance and kinetic maps from molecular dynamics simulation http://arxiv.org/abs/1506.06259

Methods

__init__(lag[, dim, var_cutoff, ...]) Time-lagged independent component analysis (TICA) [1], [2], [3].
describe(*args, **kwargs) Get a descriptive string representation of this class.
dimension() output dimension
estimate(X, **kwargs)
fit(X) Estimates parameters - for compatibility with sklearn.
fit_transform(X[, y]) Fit to data, then transform it.
get_output([dimensions, stride, skip, chunk])
get_params([deep]) Get parameters for this estimator.
iterator([stride, lag, chunk, ...])
n_frames_total([stride]) Returns total number of frames.
number_of_trajectories() Returns the number of trajectories.
output_type() By default transformers return single precision floats.
parametrize([stride])
partial_fit(X)
register_progress_callback(call_back[, stage]) Registers the progress reporter.
set_params(**params) Set the parameters of this estimator.
trajectory_length(itraj[, stride, skip]) Returns the length of trajectory of the requested index.
trajectory_lengths([stride, skip]) Returns the length of each trajectory.
transform(X) Maps the input data through the transformer to correspondingly shaped output data array/list.
write_to_csv([filename, extension, ...]) write all data to csv with numpy.savetxt

Attributes

chunksize
cov
cov_tau
cumvar Cumulative sum of the the TICA eigenvalues
data_producer
default_chunksize
eigenvalues Eigenvalues of the TICA problem (usually denoted \(\lambda\)
eigenvectors Eigenvectors of the TICA problem, columnwise
feature_TIC_correlation Instantaneous correlation matrix between input features and TICs
filenames Property which returns a list of filenames the data is originally from.
in_memory are results stored in memory?
is_random_accessible Check if self._is_random_accessible is set to true and if all the random access strategies are implemented.
is_reader Property telling if this data source is a reader or not.
lag lag time of correlation matrix \(C_{ au}\)
logger The logger for this class instance
mean mean of input features
model The model estimated by this Estimator
mu
name The name of this instance
ndim
ntraj
ra_itraj_cuboid Implementation of random access with slicing that can be up to 3-dimensional, where the first dimension corresponds to the trajectory index, the second dimension corresponds to the frames and the third dimension corresponds to the dimensions of the frames.
ra_itraj_jagged Behaves like ra_itraj_cuboid just that the trajectories are not truncated and returned as a list.
ra_itraj_linear Implementation of random access that takes arguments as the default random access (i.e., up to three dimensions with trajs, frames and dims, respectively), but which considers the frame indexing to be contiguous.
ra_linear Implementation of random access that takes a (maximal) two-dimensional slice where the first component corresponds to the frames and the second component corresponds to the dimensions.
show_progress
timescales Implied timescales of the TICA transformation
cumvar

Cumulative sum of the the TICA eigenvalues

Returns:cumvar
Return type:1D np.array
describe(*args, **kwargs)

Get a descriptive string representation of this class.

dimension()

output dimension

eigenvalues

Eigenvalues of the TICA problem (usually denoted \(\lambda\)

Returns:eigenvalues
Return type:1D np.array
eigenvectors

Eigenvectors of the TICA problem, columnwise

Returns:eigenvectors
Return type:(N,M) ndarray
feature_TIC_correlation

Instantaneous correlation matrix between input features and TICs

Denoting the input features as \(X_i\) and the TICs as \(\theta_j\), the instantaneous, linear correlation between them can be written as

\[\mathbf{Corr}(X_i, \mathbf{\theta}_j) = \frac{1}{\sigma_{X_i}}\sum_l \sigma_{X_iX_l} \mathbf{U}_{li}\]

The matrix \(\mathbf{U}\) is the matrix containing, as column vectors, the eigenvectors of the TICA generalized eigenvalue problem .

Returns:feature_TIC_correlation – correlation matrix between input features and TICs. There is a row for each feature and a column for each TIC.
Return type:ndarray(n,m)
filenames

Property which returns a list of filenames the data is originally from. :returns: list of str :rtype: list of filenames if data is originating from a file based reader

fit(X)

Estimates parameters - for compatibility with sklearn.

Parameters:X (object) – A reference to the data from which the model will be estimated
Returns:estimator – The estimator (self) with estimated model.
Return type:object
fit_transform(X, y=None, **fit_params)

Fit to data, then transform it. Fits transformer to X and y with optional parameters fit_params and returns a transformed version of X. :param X: Training set. :type X: numpy array of shape [n_samples, n_features] :param y: Target values. :type y: numpy array of shape [n_samples]

Returns:X_new – Transformed array.
Return type:numpy array of shape [n_samples, n_features_new]
get_params(deep=True)

Get parameters for this estimator.

Parameters:deep (boolean, optional) – If True, will return the parameters for this estimator and contained subobjects that are estimators.
Returns:params – Parameter names mapped to their values.
Return type:mapping of string to any
in_memory

are results stored in memory?

is_random_accessible

Check if self._is_random_accessible is set to true and if all the random access strategies are implemented. :returns: bool :rtype: Returns True if random accessible via strategies and False otherwise.

is_reader

Property telling if this data source is a reader or not. :returns: bool :rtype: True if this data source is a reader and False otherwise

lag

lag time of correlation matrix \(C_{ au}\)

logger

The logger for this class instance

mean

mean of input features

model

The model estimated by this Estimator

n_frames_total(stride=1)

Returns total number of frames.

Parameters:stride (int) – return value is the number of frames in trajectories when running through them with a step size of stride.
Returns:int
Return type:n_frames_total
name

The name of this instance

number_of_trajectories()

Returns the number of trajectories.

Returns:int
Return type:number of trajectories
output_type()

By default transformers return single precision floats.

ra_itraj_cuboid

Implementation of random access with slicing that can be up to 3-dimensional, where the first dimension corresponds to the trajectory index, the second dimension corresponds to the frames and the third dimension corresponds to the dimensions of the frames.

The with the frame slice selected frames will be loaded from each in the trajectory-slice selected trajectories and then sliced with the dimension slice. For example: The data consists out of three trajectories with length 10, 20, 10, respectively. The slice data[:, :15, :3] returns a 3D array of shape (3, 10, 3), where the first component corresponds to the three trajectories, the second component corresponds to 10 frames (note that the last 5 frames are being truncated as the other two trajectories only have 10 frames) and the third component corresponds to the selected first three dimensions.

Returns:Returns an object that allows access by slices in the described manner.
ra_itraj_jagged

Behaves like ra_itraj_cuboid just that the trajectories are not truncated and returned as a list.

Returns:Returns an object that allows access by slices in the described manner.
ra_itraj_linear

Implementation of random access that takes arguments as the default random access (i.e., up to three dimensions with trajs, frames and dims, respectively), but which considers the frame indexing to be contiguous. Therefore, it returns a simple 2D array.

Returns:A 2D array of the sliced data containing [frames, dims].
ra_linear

Implementation of random access that takes a (maximal) two-dimensional slice where the first component corresponds to the frames and the second component corresponds to the dimensions. Here it is assumed that the frame indexing is contiguous, i.e., the first frame of the second trajectory has the index of the last frame of the first trajectory plus one.

Returns:Returns an object that allows access by slices in the described manner.
register_progress_callback(call_back, stage=0)

Registers the progress reporter.

Parameters:
  • call_back (function) –

    This function will be called with the following arguments:

    1. stage (int)
    2. instance of pyemma.utils.progressbar.ProgressBar
    3. optional *args and named keywords (**kw), for future changes
  • stage (int, optional, default=0) – The stage you want the given call back function to be fired.
set_params(**params)

Set the parameters of this estimator. The method works on simple estimators as well as on nested objects (such as pipelines). The former have parameters of the form <component>__<parameter> so that it’s possible to update each component of a nested object. :returns: :rtype: self

timescales

Implied timescales of the TICA transformation

For each \(i\)-th eigenvalue, this returns

\[t_i = -\frac{\tau}{\log(|\lambda_i|)}\]

where \(\tau\) is the lag of the TICA object and \(\lambda_i\) is the i-th eigenvalue of the TICA object.

Returns:timescales – numpy array with the implied timescales. In principle, one should expect as many timescales as input coordinates were available. However, less eigenvalues will be returned if the TICA matrices were not full rank or var_cutoff was parsed
Return type:1D np.array
trajectory_length(itraj, stride=1, skip=None)

Returns the length of trajectory of the requested index.

Parameters:
  • itraj (int) – trajectory index
  • stride (int) – return value is the number of frames in the trajectory when running through it with a step size of stride.
Returns:

int

Return type:

length of trajectory

trajectory_lengths(stride=1, skip=0)

Returns the length of each trajectory.

Parameters:
  • stride (int) – return value is the number of frames of the trajectories when running through them with a step size of stride.
  • skip (int) – skip parameter
Returns:

array(dtype=int)

Return type:

containing length of each trajectory

transform(X)

Maps the input data through the transformer to correspondingly shaped output data array/list.

Parameters:X (ndarray(T, n) or list of ndarray(T_i, n)) – The input data, where T is the number of time steps and n is the number of dimensions. If a list is provided, the number of time steps is allowed to vary, but the number of dimensions are required to be to be consistent.
Returns:Y – The mapped data, where T is the number of time steps of the input data and d is the output dimension of this transformer. If called with a list of trajectories, Y will also be a corresponding list of trajectories
Return type:ndarray(T, d) or list of ndarray(T_i, d)
write_to_csv(filename=None, extension='.dat', overwrite=False, stride=1, chunksize=100, **kw)

write all data to csv with numpy.savetxt

Parameters:
  • filename (str, optional) –

    filename string, which may contain placeholders {itraj} and {stride}:

    • itraj will be replaced by trajetory index
    • stride is stride argument of this method

    If filename is not given, it is being tried to obtain the filenames from the data source of this iterator.

  • extension (str, optional, default='.dat') – filename extension of created files
  • overwrite (bool, optional, default=False) – shall existing files be overwritten? If a file exists, this method will raise.
  • stride (int) – omit every n’th frame
  • chunksize (int) – how many frames to process at once
  • kw (dict) – named arguments passed into numpy.savetxt (header, seperator etc.)

Example

Assume you want to save features calculated by some FeatureReader to ASCII: >>> import numpy as np, pyemma >>> from pyemma.util.files import TemporaryDirectory >>> import os >>> data = [np.random.random((10,3))] * 3 >>> reader = pyemma.coordinates.source(data) >>> filename = “distances_{itraj}.dat” >>> with TemporaryDirectory() as td: ... os.chdir(td) ... reader.write_to_csv(filename, header=’‘, delim=’;’) ... print(os.listdir(‘.’)) [‘distances_2.dat’, ‘distances_1.dat’, ‘distances_0.dat’]