Loading...
Exploring Methods for Comparing Similarity of Dimensionally Inconsistent Multivariate Numerical Data
Micic, Natasha Torgunov, Denis
Micic, Natasha
Torgunov, Denis
Publication Date
2018-06-28
End of Embargo
Supervisor
Rights
Peer-Reviewed
Yes
Open Access status
restrictedAccess
Accepted for publication
Institution
Department
Awarded
Embargo end date
Additional title
Abstract
When developing multivariate data classification and clustering methodologies for data mining, it is clear that most literature
contributions only really consider data that contain consistently the same attributes. There are however many cases in current big data analytics applications where for same topic and even same source data sets there are differing attributes being measured, for a multitude of reasons (whether the specific design of an experiment or poor data quality and consistency). We define this class of data a dimensionally inconsistent multivariate data, a topic that can be considered a subclass of the Big Data Variety research. This paper explores some classification methodologies commonly used in multivariate classification and clustering tasks and considers how these traditional methodologies could be adapted to compare dimensionally inconsistent data sets. The study focuses on adapting two similarity measures: Robinson-Foulds tree distance metrics and Variation of Information; for comparing clustering of hierarchical cluster algorithms (such clusters are derived from the raw multivariate data). The results from experiments on engineering data highlight that adapting pairwise measures to exclude non-common attributes from the traditional distance metrics may not be the best method of classification. We suggest that more specialised metrics of similarity are required to address challenges presented by dimensionally inconsistent multivariate data, with specific applications for big engineering data analytics.
Version
No full-text in the repository
Citation
Micic N, Neagu CD, Torgunov D et al (2018) Exploring Methods for Comparing Similarity of Dimensionally Inconsistent Multivariate Numerical Data. [Proceedings of the] 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems. IEEE. ISBN: 978-1-5386-6614-2. Pp. 1530-1537.
Link to publisher’s version
Link to published version
Link to Version of Record
Type
Conference paper