Interpretation, Identification and Reuse of Models. Theory and algorithms with applications in predictive toxicology.
View/
PhDThesis_AP.pdf (3.660Mb)
Download
Publication date
2015-07-15Supervisor
Neagu, DanielRidley, Mick J.
Travis, Kim
Rights
The University of Bradford theses are licenced under a Creative Commons Licence.
Institution
University of BradfordDepartment
School of Electrical Engineering and Computer ScienceAwarded
2014Metadata
Show full item recordAbstract
This thesis is concerned with developing methodologies that enable existing models to be effectively reused. Results of this thesis are presented in the framework of Quantitative Structural-Activity Relationship (QSAR) models, but their application is much more general. QSAR models relate chemical structures with their biological, chemical or environmental activity. There are many applications that offer an environment to build and store predictive models. Unfortunately, they do not provide advanced functionalities that allow for efficient model selection and for interpretation of model predictions for new data. This thesis aims to address these issues and proposes methodologies for dealing with three research problems: model governance (management), model identification (selection), and interpretation of model predictions. The combination of these methodologies can be employed to build more efficient systems for model reuse in QSAR modelling and other areas. The first part of this study investigates toxicity data and model formats and reviews some of the existing toxicity systems in the context of model development and reuse. Based on the findings of this review and the principles of data governance, a novel concept of model governance is defined. Model governance comprises model representation and model governance processes. These processes are designed and presented in the context of model management. As an application, minimum information requirements and an XML representation for QSAR models are proposed. Once a collection of validated, accepted and well annotated models is available within a model governance framework, they can be applied for new data. It may happen that there is more than one model available for the same endpoint. Which one to chose? The second part of this thesis proposes a theoretical framework and algorithms that enable automated identification of the most reliable model for new data from the collection of existing models. The main idea is based on partitioning of the search space into groups and assigning a single model to each group. The construction of this partitioning is difficult because it is a bi-criteria problem. The main contribution in this part is the application of Pareto points for the search space partition. The proposed methodology is applied to three endpoints in chemoinformatics and predictive toxicology. After having identified a model for the new data, we would like to know how the model obtained its prediction and how trustworthy it is. An interpretation of model predictions is straightforward for linear models thanks to the availability of model parameters and their statistical significance. For non linear models this information can be hidden inside the model structure. This thesis proposes an approach for interpretation of a random forest classification model. This approach allows for the determination of the influence (called feature contribution) of each variable on the model prediction for an individual data. In this part, there are three methods proposed that allow analysis of feature contributions. Such analysis might lead to the discovery of new patterns that represent a standard behaviour of the model and allow additional assessment of the model reliability for new data. The application of these methods to two standard benchmark datasets from the UCI machine learning repository shows a great potential of this methodology. The algorithm for calculating feature contributions has been implemented and is available as an R package called rfFC.Type
ThesisQualification name
PhDCollections
Related items
Showing items related by title, author, creator and subject.
-
Hybrid Dynamic Modelling of Engine Emissions on Multi-Physics Simulation Platform. A Framework Combining Dynamic and Statistical Modelling to Develop Surrogate Models of System of Internal Combustion Engine for Emission ModellingThe data-driven models used for the design of powertrain controllers are typically based on the data obtained from steady-state experiments. However, they are only valid under stable conditions and do not provide any information on the dynamic behaviour of the system. In order to capture this behaviour, dynamic modelling techniques are intensively studied to generate alternative solutions for engine mapping and calibration problem, aiming to address the need to increase productivity (reduce development time) and to develop better models for the actual behaviour of the engine under real-world conditions. In this thesis, a dynamic modelling approach is presented undertaken for the prediction of NOx emissions for a 2.0 litre Diesel engine, based on a coupled pre-validated virtual Diesel engine model (GT- Suite ® 1-D air path model) and in-cylinder combustion model (CMCL ® Stochastic Reactor Model Engine Suite). In the context of the considered Engine Simulation Framework, GT Suite + Stochastic Reactor Model (SRM), one fundamental problem is to establish a real time stochastic simulation capability. This problem can be addressed by replacing the slow combustion chemistry solver (SRM) with an appropriate NOx surrogate model. The approach taken in this research for the development of this surrogate model was based on a combination of design of dynamic experiments run on the virtual diesel engine model (GT- Suite), with a dynamic model fitted for the parameters required as input to the SRM, with a zonal design of experiments (DoEs), using Optimal Latin Hypercubes (OLH), run on the SRM model. A response surface model was fitted on the predicted NOx from the SRM OLH DoE data. This surrogate NOx model was then used to replace the computationally expensive SRM simulation, enabling real-time simulations of transient drive cycles to be executed. The performance of the approach was validated on a simulated NEDC drive cycle, against experimental data collected for the engine case study. The capability of methodology to capture the transient trends of the system shows promising results and will be used for the development of global surrogate prediction models for engine-out emissions.
-
Hybrid Dynamic Modelling of Engine Emissions on Multi-Physics Simulation PlatformThis paper introduces a hybrid dynamic modelling approach for the prediction of NOx emissions for a Diesel engine, based on a multi-physics simulation platform coupling a 1-D air path model (GT-Suite) with in-cylinder combustion model (CMCL Stochastic Reactor Model Engine Suite). The key motivation for this research was the requirement to establish a real time stochastic simulation capability for emissions predictions early in engine development, which required the replacement of the slow combustion chemistry solver (SRM) with an appropriate surrogate model. The novelty of the approach in this research is the introduction of a hybrid approach to metamodeling that combines dynamic experiments for the gas path model with a zonal optimal space-filling design of experiments (DoEs) for the combustion model. The dynamic experiments run on the virtual Diesel engine model (GT- Suite) was used to fit a dynamic model for the parameters required as input to the SRM. Optimal Latin Hypercubes (OLH) DoE run on the SRM model was used to fit a response surface model for the NOx emissions. This surrogate NOx model was then used to replace the computationally expensive SRM simulation, enabling real time simulations of transient drive cycles to be executed. The performance of the proposed approach was validated on a simulated NEDC drive cycle against experimental data collected for the engine case study, which proved the capability of methodology to capture the transient trends for the NOx emissions. The significance of this work is that it provided an efficient approach to the development of a global model with real time transient modelling capability based on the integration of dynamic and local DoE metamodeling experiments.
