Two papers receive ACM SIGSOFT Distinguished Paper Award

August 28, 2020

ISU Department of Computer Science authors have had two papers receive an ACM SIGSOFT Distinguished Paper Award.  Association for Computing Machinery Special Interest Group on Software Engineering (ACM SIGSOFT) encourages SIGSOFT-sponsored conferences to designate a number of accepted papers for ACM SIGSOFT Distinguished Paper Awards for the conference.  The award is very competitive and only given to at most 10% of the papers accepted.

The first paper co-authored by Ph.D. student Michael Gerten, Dr. James Lathrop, Dr. Myra Cohen, and Dr. Titus Klinge (Ph.D. '16) entitled "ChemTest: An Automated Software Testing Framework for an Emerging Paradigm" will be awarded at the 35th IEEE/ACM International Conference on Automated Software Engineering.  According to the paper's abstract, "In recent years the use of non-traditional computing mechanisms has grown rapidly. One paradigm uses chemical reaction networks (CRNs) to compute via chemical interactions. CRNs are used to prototype molecular devices at the nanoscale such as intelligent drug therapeutics. In practice, these programs are first written and simulated in environments such as MatLab and later compiled into physical molecules such as DNA strands. However, techniques for testing the correctness of CRNs are lacking.  Current methods of validating CRNs include model checking and theorem proving, but these are limited in scalability.  In this paper we present the first (to the best of our knowledge) testing framework for CRNs, ChemTest.  ChemTest evaluates test oracles on individual simulation traces and supports functional, metamorphic, internal and hyper test cases. It also allows for flakiness and programs that are probabilistic.  We performed a large case study demonstrating that ChemTest can find seeded faults and scales beyond model checking.  Of our tests, 21% are inherently flaky, suggesting that systematic support for this paradigm is needed. On average, functional tests find 66.5% of the faults, while metamorphic tests find 80.4%, showing the benefit of using metamorphic relationships in our test framework.  In addition, we show how the time at evaluation impacts fault detection. "

ASE 2020 Conference is the premier research forum for Automated Software Engineering. Each year, it brings together researchers and practitioners from academia and industry to discuss foundations, techniques, and tools for automating the analysis, design, implementation, testing, and maintenance of large software systems.

The second paper co-authored by Ph.D. student Rangeet Pan and Dr. Hridesh Rajan entitled "On Decomposing a Deep Neural Network into Modules" will be awarded at the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) 2020.  According to the paper's abstract, "Deep learning is being incorporated in many modern software systems. Deep learning approaches train a deep neural network (DNN) model using training examples, and then use the DNN model for prediction. While the structure of a DNN model as layers is observable, the model is treated in its entirety as a monolithic component. To change the logic implemented by the model, e.g. to add/remove logic that recognizes inputs belonging to a certain class, or to replace the logic with an alternative, the training examples need to be changed and the DNN needs to be retrained using the new set of examples. We argue that decomposing a DNN into DNN modules-akin to decomposing a monolithic software code into modules-can bring the benefits of modularity to deep learning. In this work, we develop a methodology for decomposing DNNs for multi-class problems into DNN modules. For four canonical problems, namely MNIST, EMNIST, FMNIST, and KMNIST, we demonstrate that such decomposition enables reuse of DNN modules to create different DNNs, enables replacement of one DNN module in a DNN with another without needing to retrain. The DNN models formed by composing DNN modules are at least as good as traditional monolithic DNNs in terms of test accuracy for our problems."  So far deep neural networks, the machine learning models used for deep learning, are thought of as monolithic machine learning models. This work shows for the first time that it is possible to decompose a deep neural network into parts so that these parts can be reused to create another deep neural network and replaced to improve the machine learning model.  

ESEC/FSE is an internationally renowned forum for researchers, practitioners, and educators to present and discuss the most recent innovations, trends, experiences, and challenges in the field of software engineering. Along with the International Conference on Software Engineering (ICSE), it is widely recognized as the top-2 conferences in software engineering. ESEC/FSE brings together experts from academia and industry to exchange the latest research results and trends as well as their practical application in all areas of software engineering.