Auxiliary information for a dataset, including mappings to/from strings (or other types) and the datatype of each dimension. More...
Public Member Functions | |
DatasetMapper (const size_t dimensionality=0) | |
Create the DatasetMapper object with the given dimensionality. More... | |
DatasetMapper (PolicyType &policy, const size_t dimensionality=0) | |
Create the DatasetMapper object with the given policy and dimensionality. More... | |
size_t | Dimensionality () const |
Get the dimensionality of the DatasetMapper object (that is, how many dimensions it has information for). More... | |
template < typename T > | |
void | MapFirstPass (const InputType &input, const size_t dimension) |
Preprocessing: during a first pass of the data, pass the input on to the MapPolicy if they are needed. More... | |
template < typename T > | |
T | MapString (const InputType &input, const size_t dimension) |
Given the input and the dimension to which it belongs, return its numeric mapping. More... | |
size_t | NumMappings (const size_t dimension) const |
Get the number of mappings for a particular dimension. More... | |
template < typename T > | |
size_t | NumUnmappings (const T value, const size_t dimension) const |
Get the number of possible unmappings for a string in a given dimension. More... | |
const PolicyType & | Policy () const |
Return the policy of the mapper. More... | |
PolicyType & | Policy () |
Modify the policy of the mapper (be careful!). More... | |
void | Policy (PolicyType &&policy) |
Modify (Replace) the policy of the mapper with a new policy. More... | |
template < typename Archive > | |
void | serialize (Archive &ar, const uint32_t) |
Serialize the dataset information. More... | |
void | SetDimensionality (const size_t dimensionality) |
Set the dimensionality of an existing DatasetMapper object. More... | |
Datatype | Type (const size_t dimension) const |
Return the type of a given dimension (numeric or categorical). More... | |
Datatype & | Type (const size_t dimension) |
Modify the type of a given dimension (be careful!). More... | |
template < typename T > | |
const InputType & | UnmapString (const T value, const size_t dimension, const size_t unmappingIndex=0) const |
Return the input that corresponds to a given value in a given dimension. More... | |
PolicyType::MappedType | UnmapValue (const InputType &input, const size_t dimension) |
Return the value that corresponds to a given input in a given dimension. More... | |
Auxiliary information for a dataset, including mappings to/from strings (or other types) and the datatype of each dimension.
DatasetMapper objects are optionally produced by data::Load(), and store the type of each dimension (Datatype::numeric or Datatype::categorical) as well as mappings from strings to unsigned integers and vice versa.
DatasetMapper objects can also map from arbitrary types; the type to map from can be specified with the InputType template parameter. By default, the InputType parameter is std::string.
PolicyType | Mapping policy used to specify MapString(). |
InputType | Type of input to be mapped. |
Definition at line 41 of file dataset_mapper.hpp.
|
explicit |
Create the DatasetMapper object with the given dimensionality.
Note that the dimensionality cannot be changed later; you will have to create a new DatasetMapper object.
|
explicit |
Create the DatasetMapper object with the given policy and dimensionality.
Note that the dimensionality cannot be changed later; you will have to create a new DatasetMapper object. Policy can be modified by the modifier.
size_t Dimensionality | ( | ) | const |
Get the dimensionality of the DatasetMapper object (that is, how many dimensions it has information for).
If this object was created by a call to mlpack::data::Load(), then the dimensionality will be the same as the number of rows (dimensions) in the dataset.
Referenced by LoadCSV::GetMatrixSize(), and LoadCSV::GetTransposeMatrixSize().
void MapFirstPass | ( | const InputType & | input, |
const size_t | dimension | ||
) |
Preprocessing: during a first pass of the data, pass the input on to the MapPolicy if they are needed.
input | Input to map. |
dimension | Dimension to map for. |
T MapString | ( | const InputType & | input, |
const size_t | dimension | ||
) |
Given the input and the dimension to which it belongs, return its numeric mapping.
If no mapping yet exists, the input is added to the list of mappings for the given dimension. The dimension parameter refers to the index of the dimension of the string (i.e. the row in the dataset).
T | Numeric type to map to (int/double/float/etc.). |
input | Input to find/create mapping for. |
dimension | Index of the dimension of the string. |
Referenced by MockCategoricalData(), and mlpack::util::SetParamWithInfo().
size_t NumMappings | ( | const size_t | dimension | ) | const |
Get the number of mappings for a particular dimension.
If the dimension is numeric, then this will return 0.
size_t NumUnmappings | ( | const T | value, |
const size_t | dimension | ||
) | const |
Get the number of possible unmappings for a string in a given dimension.
const PolicyType& Policy | ( | ) | const |
Return the policy of the mapper.
Referenced by DatasetMapper< mlpack::data::IncrementPolicy, double >::serialize().
PolicyType& Policy | ( | ) |
Modify the policy of the mapper (be careful!).
void Policy | ( | PolicyType && | policy | ) |
Modify (Replace) the policy of the mapper with a new policy.
|
inline |
Serialize the dataset information.
Definition at line 154 of file dataset_mapper.hpp.
void SetDimensionality | ( | const size_t | dimensionality | ) |
Set the dimensionality of an existing DatasetMapper object.
This resets all mappings (but not the PolicyType).
dimensionality | New dimensionality. |
Referenced by LoadCSV::GetMatrixSize(), LoadCSV::GetTransposeMatrixSize(), and LoadBostonHousingDataset().
Datatype Type | ( | const size_t | dimension | ) | const |
Return the type of a given dimension (numeric or categorical).
Referenced by LoadBostonHousingDataset(), MockCategoricalData(), and mlpack::util::SetParamWithInfo().
Datatype& Type | ( | const size_t | dimension | ) |
Modify the type of a given dimension (be careful!).
const InputType& UnmapString | ( | const T | value, |
const size_t | dimension, | ||
const size_t | unmappingIndex = 0 |
||
) | const |
Return the input that corresponds to a given value in a given dimension.
If the value is not a valid mapping in the given dimension, a std::invalid_argument is thrown. Note that this does not remove the mapping.
If the mapping is non-unique (i.e. many strings can map to the same value), then you can pass a different value for unmappingIndex to get a different string that maps to the given value. unmappingIndex should be in the range from 0 to (NumUnmappings(value, dimension) - 1).
If the mapping is unique (which it is for DatasetInfo), then the unmappingIndex parameter can be left as the default.
value | Mapped value for input. |
dimension | Dimension to unmap string from. |
unmappingIndex | Index of non-unique unmapping (optional). |
PolicyType::MappedType UnmapValue | ( | const InputType & | input, |
const size_t | dimension | ||
) |
Return the value that corresponds to a given input in a given dimension.
If the value is not a valid mapping in the given dimension, a std::invalid_argument is thrown. Note that this does not remove the mapping.
input | Mapped input for value. |
dimension | Dimension to unmap input from. |