R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.
| Version: | 1.9.3 |
| Depends: | R (≥ 3.2) |
| Imports: | config (≥ 0.2),DBI (≥ 1.0.0),dbplyr (≥ 2.5.0),dplyr (≥1.0.9),generics,globals,glue,httr (≥ 1.2.1),jsonlite (≥1.4), methods,openssl (≥ 0.8),purrr,rlang (≥ 0.1.4),rstudioapi (≥ 0.10),tidyr (≥ 1.2.0),tidyselect,uuid,vctrs,withr,xml2 |
| Suggests: | arrow (≥ 0.17.0),broom,diffobj,foreach,ggplot2,iterators,janeaustenr,Lahman,mlbench,nnet,nycflights13,R6,r2d3,RCurl,reshape2,shiny (≥ 1.0.1),parsnip,testthat,rprojroot |
| Published: | 2025-11-19 |
| DOI: | 10.32614/CRAN.package.sparklyr |
| Author: | Javier Luraschi [aut], Kevin Kuo [aut], Kevin Ushey [aut], JJ Allaire [aut], Samuel Macedo [ctb], Hossein Falaki [aut], Lu Wang [aut], Andy Zhang [aut], Yitao Li [aut], Jozef Hajnala [ctb], Maciej Szymkiewicz [ctb], Wil Davis [ctb], Edgar Ruiz [aut, cre], RStudio [cph], The Apache Software Foundation [aut, cph] |
| Maintainer: | Edgar Ruiz <edgar at rstudio.com> |
| BugReports: | https://github.com/sparklyr/sparklyr/issues |
| License: | Apache License 2.0 | fileLICENSE |
| URL: | https://spark.posit.co/ |
| NeedsCompilation: | no |
| SystemRequirements: | Spark: 2.x, or 3.x, or 4.x |
| Materials: | README,NEWS |
| In views: | Databases,ModelDeployment |
| CRAN checks: | sparklyr results |