- Notifications
You must be signed in to change notification settings - Fork6
Closed
Assignees
Description
Issue Description
I don't know if you remember, but not to long ago we discovered an issue in paws.common together and in an issue that had to do with pulling in profiles into theprofile parameter intodbConnect(). Everything works fine even with AWS_PROFILE as env variables. I've been working with the updated packages and a new error prevents me from running a script on the server.
When I run a query, the data is pulled and written into anr object (seetest_results below). However, I also get this error message:
Info: (Datascanned:625.16GB)additionalargumentsignoredin warning()Warning: AccessDenied (HTTP403).AccessDenied
Which is weird since the data are actually pulled and the connection to the database is successfully established. Any idea why this message is popping up?
As always, any insights would be great!
Reproducible Example
Example:
library(RJDBC)library(glue)library(tidyverse)library(magrittr)library(rlang)library(noctua)library(DBI)library(paws.common)library(paws)con_3<- dbConnect(noctua::athena(),profile_name="profile",s3_staging_dir="s3://aws-athena-query-results-XXXXXXXXXX-us-east-1/",region="us-east-1")test_query<- glue_sql("select event_date, count(x) as x_count from logs.x group by 1 limit 10;",.con=con_3)# make sure all results are returned from athenasetMethod("dbGetQuery", signature(conn="JDBCConnection", statement="character"), def=function(conn, statement, ...) {r<- dbSendQuery(con,test_query)on.exit(.jcall(r@stat,"V","close"))if (conn@jc %instanceof%"com.amazonaws.athena.jdbc.AthenaConnection") fetch(r,-1,999)# Athena can only pull 999 rows at a timeelse fetch(r,-1)})test_results<- dbGetQuery(conn=con_3,statement=test_query)
Session Info
>devtools::session_info()─Sessioninfo ───────────────────────────────────────────────────────────────────────────────────────────────────────settingvalueversionRversion3.5.3 (2019-03-11)osmacOS10.15.3systemx86_64,darwin15.6.0uiRStudio language (EN)collateen_US.UTF-8ctypeen_US.UTF-8tzAmerica/New_Yorkdate2020-06-12 ─Packages ───────────────────────────────────────────────────────────────────────────────────────────────────────────package*versiondatelibsourceassertthat0.2.12019-03-21 [2] CRAN (R3.5.2)backports1.1.72020-05-13 [1] CRAN (R3.5.3)bit1.1-15.12020-01-14 [2] CRAN (R3.5.2)bit640.9-72017-05-08 [2] CRAN (R3.5.0)blob1.2.12020-01-20 [2] CRAN (R3.5.2)broom0.5.62020-04-20 [1] CRAN (R3.5.3)callr3.4.32020-03-28 [1] CRAN (R3.5.3)cellranger1.1.02016-07-27 [2] CRAN (R3.5.0)cli2.0.22020-02-28 [1] CRAN (R3.5.2)colorspace1.4-12019-03-18 [1] CRAN (R3.5.2)crayon1.3.42017-09-16 [2] CRAN (R3.5.0)curl4.32019-12-02 [1] CRAN (R3.5.2)data.table1.12.82019-12-09 [1] CRAN (R3.5.2)DBI*1.1.02019-12-15 [2] CRAN (R3.5.2)dbplyr1.4.42020-05-27 [1] CRAN (R3.5.3)desc1.2.02018-05-01 [2] CRAN (R3.5.0)devtools2.3.02020-04-10 [1] CRAN (R3.5.3)digest0.6.252020-02-23 [1] CRAN (R3.5.2)dplyr*0.8.52020-03-07 [1] CRAN (R3.5.2)ellipsis0.3.12020-05-15 [1] CRAN (R3.5.3)fansi0.4.12020-01-08 [2] CRAN (R3.5.2)forcats*0.5.02020-03-01 [1] CRAN (R3.5.2)fs1.4.12020-04-04 [1] CRAN (R3.5.3)generics0.0.22018-11-29 [1] CRAN (R3.5.0)ggplot2*3.3.02020-03-05 [1] CRAN (R3.5.2)glue*1.4.12020-05-13 [1] CRAN (R3.5.3)gt*0.2.12020-05-23 [1] CRAN (R3.5.3)gtable0.3.02019-03-25 [2] CRAN (R3.5.3)haven2.3.02020-05-24 [1] CRAN (R3.5.3)hms0.5.32020-01-08 [1] CRAN (R3.5.2)httr1.4.12019-08-05 [1] CRAN (R3.5.2)ini0.3.12018-05-20 [2] CRAN (R3.5.0)jsonlite1.6.12020-02-02 [1] CRAN (R3.5.2)knitr1.282020-02-06 [1] CRAN (R3.5.2)lattice0.20-382018-11-04 [2] CRAN (R3.5.3)lifecycle0.2.02020-03-06 [1] CRAN (R3.5.2)lubridate1.7.82020-04-06 [1] CRAN (R3.5.3)magrittr*1.52014-11-22 [2] CRAN (R3.5.0)memoise1.1.02017-04-21 [2] CRAN (R3.5.0)modelr0.1.82020-05-19 [1] CRAN (R3.5.3)munsell0.5.02018-06-12 [2] CRAN (R3.5.0)nlme3.1-1432019-12-10 [2] CRAN (R3.5.2)noctua*1.7.02020-05-14 [1] CRAN (R3.5.3)packrat0.5.02018-11-14 [2] CRAN (R3.5.0)paws*0.1.82020-04-28 [1] CRAN (R3.5.3)paws.analytics0.1.82020-04-26 [1] CRAN (R3.5.3)paws.common*0.3.12020-04-26 [1] CRAN (R3.5.3)paws.storage0.1.82020-04-27 [1] CRAN (R3.5.3)pillar1.4.32019-12-20 [1] CRAN (R3.5.2)pkgbuild1.0.62019-10-09 [2] CRAN (R3.5.2)pkgconfig2.0.32019-09-22 [2] CRAN (R3.5.2)pkgload1.0.22018-10-29 [2] CRAN (R3.5.0)prettyunits1.1.12020-01-24 [2] CRAN (R3.5.2)processx3.4.22020-02-09 [1] CRAN (R3.5.2)ps1.3.22020-02-13 [1] CRAN (R3.5.2)purrr*0.3.42020-04-17 [1] CRAN (R3.5.3)R62.4.12019-11-12 [1] CRAN (R3.5.2)Rcpp1.0.4.62020-04-09 [1] CRAN (R3.5.3)readr*1.3.12018-12-21 [1] CRAN (R3.5.0)readxl1.3.12019-03-13 [1] CRAN (R3.5.2)remotes2.1.12020-02-15 [1] CRAN (R3.5.2)reprex0.3.02019-05-16 [2] CRAN (R3.5.2)rJava*0.9-112019-03-29 [2] CRAN (R3.5.2)RJDBC*0.2-7.12018-04-16 [2] CRAN (R3.5.0)rlang*0.4.62020-05-02 [1] CRAN (R3.5.3)RPostgreSQL0.6-22017-06-24 [2] CRAN (R3.5.0)rprojroot1.3-22018-01-03 [2] CRAN (R3.5.0)rstudioapi0.112020-02-07 [1] CRAN (R3.5.2)rvest0.3.52019-11-08 [1] CRAN (R3.5.2)scales1.1.02019-11-18 [2] CRAN (R3.5.2)sessioninfo1.1.12018-11-05 [2] CRAN (R3.5.0)stringi1.4.62020-02-17 [1] CRAN (R3.5.2)stringr*1.4.02019-02-10 [1] CRAN (R3.5.2)testthat2.3.22020-03-02 [1] CRAN (R3.5.2)tibble*3.0.12020-04-20 [1] CRAN (R3.5.3)tidyr*1.0.22020-01-24 [1] CRAN (R3.5.2)tidyselect1.0.02020-01-27 [2] CRAN (R3.5.3)tidyverse*1.3.02019-11-21 [1] CRAN (R3.5.2)usethis1.6.12020-04-29 [2] CRAN (R3.5.3)vctrs0.3.02020-05-11 [1] CRAN (R3.5.3)withr2.2.02020-04-20 [1] CRAN (R3.5.3)xfun0.122020-01-13 [1] CRAN (R3.5.2)xml21.3.22020-04-23 [1] CRAN (R3.5.3)