Movatterモバイル変換


[0]ホーム

URL:


Scala 3
3.7.4
LearnInstallPlaygroundFind A LibraryCommunityBlog
Scala 3
LearnInstallPlaygroundFind A LibraryCommunityBlog
DocsAPI
Generated with
Copyright (c) 2002-2025, LAMP/EPFL
Copyright (c) 2002-2025, LAMP/EPFL
Scala 3/scala/scala.sys/scala.sys.process

scala.sys.process

This package handles the execution of external processes. The contents of this package can be divided in three groups, according to their responsibilities:

  • Indicating what to run and how to run it.

  • Handling a process input and output.

  • Running the process.

For simple uses, the only group that matters is the first one. Running an external command can be as simple as"ls".!, or as complex as building a pipeline of commands such as this:

import scala.sys.process._"ls" #| "grep .scala" #&& Seq("sh", "-c", "scalac *.scala") #|| "echo nothing found" lazyLines

We describe below the general concepts and architecture of the package, and then take a closer look at each of the categories mentioned above.

Concepts and Architecture

The underlying basis for the whole package is Java'sProcess andProcessBuilder classes. While there's no need to use these Java classes, they impose boundaries on what is possible. One cannot, for instance, retrieve aprocess id for whatever is executing.

When executing an external process, one can provide a command's name, arguments to it, the directory in which it will be executed and what environment variables will be set. For each executing process, one can feed its standard input through ajava.io.OutputStream, and read from its standard output and standard error through a pair ofjava.io.InputStream. One can wait until a process finishes execution and then retrieve its return value, or one can kill an executing process. Everything else must be built on those features.

This package provides a DSL for running and chaining such processes, mimicking Unix shells ability to pipe output from one process to the input of another, or control the execution of further processes based on the return status of the previous one.

In addition to this DSL, this package also provides a few ways of controlling input and output of these processes, going from simple and easy to use to complex and flexible.

When processes are composed, a newProcessBuilder is created which, when run, will execute theProcessBuilder instances it is composed of according to the manner of the composition. If piping one process to another, they'll be executed simultaneously, and each will be passed aProcessIO that will copy the output of one to the input of the other.

What to Run and How

The central component of the process execution DSL is thescala.sys.process.ProcessBuilder trait. It isProcessBuilder that implements the process execution DSL, that creates thescala.sys.process.Process that will handle the execution, and return the results of such execution to the caller. We can see that DSL in the introductory example:#|,#&& and#!! are methods onProcessBuilder used to create a newProcessBuilder through composition.

One creates aProcessBuilder either through factories on thescala.sys.process.Process's companion object, or through implicit conversions available in this package object itself. Implicitly, each process is created either out of aString, with arguments separated by spaces -- no escaping of spaces is possible -- or out of ascala.collection.Seq, where the first element represents the command name, and the remaining elements are arguments to it. In this latter case, arguments may contain spaces.

To further control what how the process will be run, such as specifying the directory in which it will be run, see the factories onscala.sys.process.Process's companion object.

Once the desiredProcessBuilder is available, it can be executed in different ways, depending on how one desires to control its I/O, and what kind of result one wishes for:

  • Return status of the process (! methods)

  • Output of the process as aString (!! methods)

  • Continuous output of the process as aLazyList[String] (lazyLines methods)

  • TheProcess representing it (run methods)

Some simple examples of these methods:

import scala.sys.process._// This uses ! to get the exit codedef fileExists(name: String) = Seq("test", "-f", name).! == 0// This uses !! to get the whole result as a stringval dirContents = "ls".!!// This "fire-and-forgets" the method, which can be lazily read through// a LazyList[String]def sourceFilesAt(baseDir: String): LazyList[String] = { val cmd = Seq("find", baseDir, "-name", "*.scala", "-type", "f") cmd.lazyLines}

We'll see more details about controlling I/O of the process in the next section.

Handling Input and Output

In the underlying Java model, once aProcess has been started, one can getjava.io.InputStream andjava.io.OutputStream representing its output and input respectively. That is, what one writes to anOutputStream is turned into input to the process, and the output of a process can be read from anInputStream -- of which there are two, one representing normal output, and the other representing error output.

This model creates a difficulty, which is that the code responsible for actually running the external processes is the one that has to take decisions about how to handle its I/O.

This package presents an alternative model: the I/O of a running process is controlled by ascala.sys.process.ProcessIO object, which can be passed _to_ the code that runs the external process. AProcessIO will have direct access to the java streams associated with the process I/O. It must, however, close these streams afterwards.

Simpler abstractions are available, however. The components of this package that handle I/O are:

Some examples of I/O handling:

import scala.sys.process._// An overly complex way of computing size of a compressed filedef gzFileSize(name: String) = { val cat = Seq("zcat", name) var count = 0 def byteCounter(input: java.io.InputStream) = {   while(input.read() != -1) count += 1   input.close() } val p = cat run new ProcessIO(_.close(), byteCounter, _.close()) p.exitValue() count}// This "fire-and-forgets" the method, which can be lazily read through// a LazyList[String], and accumulates all errors on a StringBufferdef sourceFilesAt(baseDir: String): (LazyList[String], StringBuffer) = { val buffer = new StringBuffer() val cmd = Seq("find", baseDir, "-name", "*.scala", "-type", "f") val lazyLines = cmd lazyLines_! ProcessLogger(buffer append _) (lazyLines, buffer)}

Instances of the java classesjava.io.File andjava.net.URL can both be used directly as input to other processes, andjava.io.File can be used as output as well. One can even pipe one to the other directly without any intervening process, though that's not a design goal or recommended usage. For example, the following code will copy a web page to a file:

import java.io.Fileimport java.net.URLimport scala.sys.process._new URL("https://www.scala-lang.org/") #> new File("scala-lang.html") !

More information about the other ways of controlling I/O can be found in the Scaladoc for the associated objects, traits and classes.

Running the Process

Paradoxically, this is the simplest component of all, and the one least likely to be interacted with. It consists solely ofscala.sys.process.Process, and it provides only two methods:

  • exitValue(): blocks until the process exit, and then returns the exit value. This is what happens when one uses the! method ofProcessBuilder.

  • destroy(): this will kill the external process and close the streams associated with it.

Attributes

Members list

Type members

Classlikes

objectBasicIO

This object contains factories forscala.sys.process.ProcessIO, which can be used to control the I/O of ascala.sys.process.Process when ascala.sys.process.ProcessBuilder is started with therun command.

This object contains factories forscala.sys.process.ProcessIO, which can be used to control the I/O of ascala.sys.process.Process when ascala.sys.process.ProcessBuilder is started with therun command.

It also contains some helper methods that can be used to in the creation ofProcessIO.

It is used by other classes in the package in the implementation of various features, but can also be used by client code.

Attributes

Source
BasicIO.scala
Supertypes
classObject
traitMatchable
classAny
Self type
BasicIO.type

Ascala.sys.process.ProcessLogger that writes output to a file.

Ascala.sys.process.ProcessLogger that writes output to a file.

Attributes

Source
ProcessLogger.scala
Supertypes
traitFlushable
traitCloseable
classObject
traitMatchable
classAny
Show all
traitProcess

Represents a process that is running or has finished running.

Represents a process that is running or has finished running. It may be a compound process with several underlying native processes (such asa #&& b).

This trait is often not used directly, though its companion object contains factories forscala.sys.process.ProcessBuilder, the main component of this package.

It is used directly when calling the methodrun on aProcessBuilder, which makes the process run in the background. The methods provided onProcess make it possible for one to block until the process exits and get the exit value, or destroy the process altogether.

Attributes

See also
Companion
object
Source
Process.scala
Supertypes
classObject
traitMatchable
classAny

Methods for constructing simple commands that can then be combined.

Methods for constructing simple commands that can then be combined.

Attributes

Companion
trait
Source
Process.scala
Supertypes
classObject
traitMatchable
classAny
Self type
Process.type

Represents a sequence of one or more external processes that can be executed.

Represents a sequence of one or more external processes that can be executed. AProcessBuilder can be a single external process, or a combination of otherProcessBuilder. One can control where the output of an external process will go to, and where its input will come from, or leave that decision to whoever starts it.

One creates aProcessBuilder through factories provided inscala.sys.process.Process's companion object, or implicit conversions based on these factories made available in the package objectscala.sys.process. Here are some examples:

import scala.sys.process._// Executes "ls" and sends output to stdout"ls".!// Execute "ls" and assign a `LazyList[String]` of its output to "contents".val contents = Process("ls").lazyLines// Here we use a `Seq` to make the parameter whitespace-safedef contentsOf(dir: String): String = Seq("ls", dir).!!

The methods ofProcessBuilder are divided in three categories: the ones that combine twoProcessBuilder to create a third, the ones that redirect input or output of aProcessBuilder, and the ones that execute the external processes associated with it.

CombiningProcessBuilder

Two existingProcessBuilder can be combined in the following ways:

  • They can be executed in parallel, with the output of the first being fed as input to the second, like Unix pipes. This is achieved with the#| method.

  • They can be executed in sequence, with the second starting as soon as the first ends. This is done by the### method.

  • The execution of the second one can be conditioned by the return code (exit status) of the first, either only when it's zero, or only when it's not zero. The methods#&& and#|| accomplish these tasks.

Redirecting Input/Output

Though control of input and output can be done when executing the process, there's a few methods that create a newProcessBuilder with a pre-configured input or output. They are#<,#> and#>>, and may take as input either anotherProcessBuilder (like the pipe described above), or something else such as ajava.io.File or ajava.io.InputStream. For example:

new URL("https://databinder.net/dispatch/About") #> "grep JSON" #>> new File("About_JSON") !

Starting Processes

To execute all external commands associated with aProcessBuilder, one may use one of four groups of methods. Each of these methods have various overloads and variations to enable further control over the I/O. These methods are:

  • run: the most general method, it returns ascala.sys.process.Process immediately, and the external command executes concurrently.

  • !: blocks until all external commands exit, and returns the exit code of the last one in the chain of execution.

  • !!: blocks until all external commands exit, and returns aString with the output generated.

  • lazyLines: returns immediately likerun, and the output being generated is provided through aLazyList[String]. Getting the next element of thatLazyList may block until it becomes available. This method will throw an exception if the return code is different than zero -- if this is not desired, use thelazyLines_! method.

Handling Input and Output

If not specified, the input of the external commands executed withrun or! will not be tied to anything, and the output will be redirected to the stdout and stderr of the Scala process. For the methods!! andlazyLines, no input will be provided, and the output will be directed according to the semantics of these methods.

Some methods will cause stdin to be used as input. Output can be controlled with ascala.sys.process.ProcessLogger --!! andlazyLines will only redirect error output when passed aProcessLogger. If one desires full control over input and output, then ascala.sys.process.ProcessIO can be used withrun.

For example, we could silence the error output fromlazyLines_! like this:

val etcFiles = "find /etc" lazyLines_! ProcessLogger(line => ())

Extended Example

Let's examine in detail one example of usage:

import scala.sys.process._"find src -name *.scala -exec grep null {} ;"  #|  "xargs test -z"  #&&  "echo null-free"  #||  "echo null detected"  !

Note that everyString is implicitly converted into aProcessBuilder through the implicits imported fromscala.sys.process. TheseProcessBuilder are then combined in three different ways.

  1. #| pipes the output of the first command into the input of the second command. It mirrors a shell pipe (|).

  2. #&& conditionally executes the second command if the previous one finished with exit value 0. It mirrors shell's&&.

  3. #|| conditionally executes the third command if the exit value of the previous command is different than zero. It mirrors shell's||.

Finally,! at the end executes the commands, and returns the exit value. Whatever is printed will be sent to the Scala process standard output. If we wanted to capture it, we could run that with!! instead.

Note: though it is not shown above, the equivalent of a shell's; would be###. The reason for this name is that; is a reserved token in Scala.

Attributes

Companion
object
Source
ProcessBuilder.scala
Supertypes
traitSink
traitSource
classObject
traitMatchable
classAny

This object contains traits used to describe input and output sources.

This object contains traits used to describe input and output sources.

Attributes

Companion
trait
Source
ProcessBuilder.scala
Supertypes
classObject
traitMatchable
classAny
Self type

Factories for creatingscala.sys.process.ProcessBuilder.

Factories for creatingscala.sys.process.ProcessBuilder. They can be found on and used throughscala.sys.process.Process's companion object.

Attributes

Source
Process.scala
Supertypes
classObject
traitMatchable
classAny
Known subtypes
objectProcess
finalclassProcessIO(valwriteInput:OutputStream=>Unit,valprocessOutput:InputStream=>Unit,valprocessError:InputStream=>Unit,valdaemonizeThreads:Boolean)

This class is used to control the I/O of everyscala.sys.process.Process.

This class is used to control the I/O of everyscala.sys.process.Process. The functions used to create it will be called with the process streams once it has been started. It might not be necessary to useProcessIO directly --scala.sys.process.ProcessBuilder can return the process output to the caller, or use ascala.sys.process.ProcessLogger which avoids direct interaction with a stream. One can even use the factories atBasicIO to create aProcessIO, or use its helper methods when creating one's ownProcessIO.

When creating aProcessIO, it is important toclose all streams when finished, since the JVM might use system resources to capture the process input and output, and will not release them unless the streams are explicitly closed.

ProcessBuilder will callwriteInput,processOutput andprocessError in separate threads, and if daemonizeThreads is true, they will all be marked as daemon threads.

Value parameters

daemonizeThreads

Indicates whether the newly spawned threads that will runprocessOutput,processError andwriteInput should be marked as daemon threads.

processError

Function that will be called with theInputStream from which all error output of the process must be read from. This will be called in a newly spawned thread.

processOutput

Function that will be called with theInputStream from which all normal output of the process must be read from. This will be called in a newly spawned thread.

writeInput

Function that will be called with theOutputStream to which all input to the process must be written. This will be called in a newly spawned thread.

Attributes

Note

Failure to close the passed streams may result in resource leakage.

Source
ProcessIO.scala
Supertypes
classObject
traitMatchable
classAny

Provide implicit conversions for the factories offered byscala.sys.process.Process's companion object.

Provide implicit conversions for the factories offered byscala.sys.process.Process's companion object. These implicits can then be used to decrease the noise in a pipeline of commands, making it look more shell-like. They are available through the package objectscala.sys.process.

Attributes

Source
Process.scala
Supertypes
classObject
traitMatchable
classAny

Encapsulates the output and error streams of a running process.

Encapsulates the output and error streams of a running process. This is used byscala.sys.process.ProcessBuilder when starting a process, as an alternative toscala.sys.process.ProcessIO, which can be more difficult to use. Note that aProcessLogger will be used to create aProcessIO anyway. The objectBasicIO has some functions to do that.

Here is an example that counts the number of lines in the normal and error output of a process:

import scala.sys.process._var normalLines = 0var errorLines = 0val countLogger = ProcessLogger(line => normalLines += 1,                               line => errorLines += 1)"find /etc" ! countLogger

Attributes

See also
Companion
object
Source
ProcessLogger.scala
Supertypes
classObject
traitMatchable
classAny
Known subtypes

Provides factories to createscala.sys.process.ProcessLogger, which are used to capture output ofscala.sys.process.ProcessBuilder commands when run.

Provides factories to createscala.sys.process.ProcessLogger, which are used to capture output ofscala.sys.process.ProcessBuilder commands when run.

Attributes

Companion
trait
Source
ProcessLogger.scala
Supertypes
classObject
traitMatchable
classAny
Self type

Value members

Concrete methods

The error stream of this process

The error stream of this process

Attributes

Source
package.scala

The input stream of this process

The input stream of this process

Attributes

Source
package.scala

The output stream of this process

The output stream of this process

Attributes

Source
package.scala

Implicits

Inherited implicits

implicitdefbuilderToProcess(builder:JProcessBuilder):ProcessBuilder

Implicitly convert ajava.lang.ProcessBuilder into a Scala one.

Implicitly convert ajava.lang.ProcessBuilder into a Scala one.

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala
implicitdefbuildersToProcess[T](builders:Seq[T])(implicitconvert:T=>Source):Seq[Source]

Return a sequence ofscala.sys.process.ProcessBuilder.Source from a sequence of values for which an implicit conversion toSource is available.

Return a sequence ofscala.sys.process.ProcessBuilder.Source from a sequence of values for which an implicit conversion toSource is available.

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala
implicitdeffileToProcess(file:File):FileBuilder

Implicitly convert ajava.io.File into ascala.sys.process.ProcessBuilder.FileBuilder, which can be used as either input or output of a process.

Implicitly convert ajava.io.File into ascala.sys.process.ProcessBuilder.FileBuilder, which can be used as either input or output of a process. For example:

import scala.sys.process._"ls" #> new java.io.File("dirContents.txt") !

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala

Implicitly convert a sequence ofString into ascala.sys.process.ProcessBuilder.

Implicitly convert a sequence ofString into ascala.sys.process.ProcessBuilder. The first argument will be taken to be the command to be executed, and the remaining will be its arguments. When using this, arguments may contain spaces.

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala

Implicitly convert aString into ascala.sys.process.ProcessBuilder.

Implicitly convert aString into ascala.sys.process.ProcessBuilder.

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala
implicitdefurlToProcess(url:URL):URLBuilder

Implicitly convert ajava.net.URL into ascala.sys.process.ProcessBuilder.URLBuilder , which can be used as input to a process.

Implicitly convert ajava.net.URL into ascala.sys.process.ProcessBuilder.URLBuilder , which can be used as input to a process. For example:

import scala.sys.process._Seq("xmllint", "--html", "-") #< new java.net.URL("https://www.scala-lang.org") #> new java.io.File("fixed.html") !

Attributes

Inherited from:
ProcessImplicits
Source
Process.scala
In this article
Generated with
Copyright (c) 2002-2025, LAMP/EPFL
Copyright (c) 2002-2025, LAMP/EPFL

[8]ページ先頭

©2009-2025 Movatter.jp