Skip to main navigation Skip to search Skip to main content

Executing Shell Scripts in the Wrong Order, Correctly

    • Brown University
    • University of Pennsylvania

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

    3 Scopus citations

    Abstract

    Shell scripts are critical infrastructure for developers, administrators, and scientists; and ought to enjoy the performance benefits of the full suite of advances in compiler optimizations. But between the shell's inherent challenges and neglect from the community, shell tooling and performance lags far behind the state of the art. We propose executing scripts out-of-order to better use modern computational resources. Optimizing any part of an arbitrary shell script is very challenging: the shell language's complex, late-bound semantics makes extensive use of opaque external commands with arbitrary side effects.We work with the grain of the shell's challenges, meeting dynamism with dynamism: we optimize at runtime, speculatively executing commands in an isolated and monitored environment to determine and contain their behavior. Our proposed approach can yield serious performance benefits (up to 3.9× for a bioinformatics script on a 16-core machine) for arbitrarily complex scripts without modifying their behavior. Contained out-of-order execution obviates the need for command specifications, operates on external commands, and yields a much more general framework for the shell. Script writers need not change a thing and observe no differences: they get improved performance with the interpretability of sequential output.

    Original languageEnglish
    Title of host publicationHotOS 2023 - Proceedings of the 19th Workshop on Hot Topics in Operating Systems
    Pages103-109
    Number of pages7
    ISBN (Electronic)9798400701955
    DOIs
    StatePublished - 22 Jun 2023
    Event19th Workshop on Hot Topics in Operating Systems, HotOS 2023 - Providence, United States
    Duration: 22 Jun 2023 → 24 Jun 2023

    Publication series

    NameHotOS 2023 - Proceedings of the 19th Workshop on Hot Topics in Operating Systems

    Conference

    Conference19th Workshop on Hot Topics in Operating Systems, HotOS 2023
    Country/TerritoryUnited States
    CityProvidence
    Period22/06/23 → 24/06/23

    Fingerprint

    Dive into the research topics of 'Executing Shell Scripts in the Wrong Order, Correctly'. Together they form a unique fingerprint.

    Cite this