Executing Shell Scripts in the Wrong Order, Correctly

Georgios Liargkovas, Konstantinos Kallas, Michael Greenberg, Nikos Vasilakis

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Shell scripts are critical infrastructure for developers, administrators, and scientists; and ought to enjoy the performance benefits of the full suite of advances in compiler optimizations. But between the shell's inherent challenges and neglect from the community, shell tooling and performance lags far behind the state of the art. We propose executing scripts out-of-order to better use modern computational resources. Optimizing any part of an arbitrary shell script is very challenging: the shell language's complex, late-bound semantics makes extensive use of opaque external commands with arbitrary side effects.We work with the grain of the shell's challenges, meeting dynamism with dynamism: we optimize at runtime, speculatively executing commands in an isolated and monitored environment to determine and contain their behavior. Our proposed approach can yield serious performance benefits (up to 3.9× for a bioinformatics script on a 16-core machine) for arbitrarily complex scripts without modifying their behavior. Contained out-of-order execution obviates the need for command specifications, operates on external commands, and yields a much more general framework for the shell. Script writers need not change a thing and observe no differences: they get improved performance with the interpretability of sequential output.

Original languageEnglish
Title of host publicationHotOS 2023 - Proceedings of the 19th Workshop on Hot Topics in Operating Systems
Pages103-109
Number of pages7
ISBN (Electronic)9798400701955
DOIs
StatePublished - 22 Jun 2023
Event19th Workshop on Hot Topics in Operating Systems, HotOS 2023 - Providence, United States
Duration: 22 Jun 202324 Jun 2023

Publication series

NameHotOS 2023 - Proceedings of the 19th Workshop on Hot Topics in Operating Systems

Conference

Conference19th Workshop on Hot Topics in Operating Systems, HotOS 2023
Country/TerritoryUnited States
CityProvidence
Period22/06/2324/06/23

Fingerprint

Dive into the research topics of 'Executing Shell Scripts in the Wrong Order, Correctly'. Together they form a unique fingerprint.

Cite this