Commitac8e586

Pedro Bernardo

committed

Reverted sparkSql/StackOverflowSurvey to local version

1 parent942672b commitac8e586Copy full SHA for ac8e586

File tree

-4

lines changed

-4

lines changed

Lines changed: 2 additions & 4 deletions

Original file line number	Diff line number	Diff line change
`@@ -7,15 +7,13 @@`
`7`	`7`	`if__name__=="__main__":`
`8`	`8`
`9`	`9`	`session=SparkSession.builder.appName("StackOverFlowSurvey").getOrCreate()`
`10`		`-sc=session.sparkContext`
`11`		`-sc.setLogLevel('ERROR')`
`12`		`-`
	`10`	`+`
`13`	`11`	`dataFrameReader=session.read`
`14`	`12`
`15`	`13`	`responses=dataFrameReader \`
`16`	`14`	`.option("header","true") \`
`17`	`15`	`.option("inferSchema",value=True) \`
`18`		`- .csv("s3n://stackoverflow-analytics-pedro/2016-stack-overflow-survey-responses.csv")`
	`16`	`+ .csv("in/2016-stack-overflow-survey-responses.csv")`
`19`	`17`
`20`	`18`	`print("=== Print out schema ===")`
`21`	`19`	`responses.printSchema()`

Comments

(0)