Data Boot Camp - Overview

Instructors: John Fay, Edgar Virguez, Jun Shepard
Aug 30 2, 2019 -- GH 1104

►►Course survey link: https://duke.qualtrics.com/jfe/form/SV_54PbMvAq59a5mER ◄◄

Course overview

Why this course now?

Unit 1: Analyzing water flow data with Excel (Aug 30)

• Background: How has Falls Lake reservoir impacted streamflow?

• Analytical workflow: A Preview

• Task: Exploring monthly stream flows

• Task: Evaluating changes in 100 & 500 year floods

• Task: Evaluating changes in minimum flows

• Task: Evaluating annual stream flow changes over time

  ► Completed Excel file → LINK

  ► Video capture of Unit 1 → LINK

Unit 2: Analyzing water flow data with Python & R (Sept 6)

• Overview & schedule

• Python materials

  • 00-Setting-up
  • 01-WaterFlow-Terse
  • 02a-Python-in-5-minutes
  • 02b-DataFrames
  • 03-ImportData
  • 04-Data-Exploration
  • 05-Flood-Frequency-Analysis [optional]
  • 06-Minimum-Flow-Analysis [optional]
  • 07-Trends-Over-Time [optional]
  • 08-Show-All-Sites [optional]

• R materials

  • R set-up and Exploratory Data Analysis
  • Flood return interval
  • Low flow analysis
  • Trend analysis and Leaflet
  • R-scripts: download

► Video capture of Unit 2 → LINK

► Video capture of Unit 2, in R → LINK

Unit 3: Data Visualization

• Prep (do before meeting in class!): Setting Up Your Virtual Machine

• Introduction and overview

• Part 1: Getting started with Tableau

• Part 2: Basics of plotting in Python

  • Notebook: Visualization-in-Python

  • Notebook: Mapping-with-plotnine

  • R-markdown: USGSWaterPlots

    • (Raw Rmd file)

• Part 3: Visualization in action: Water Quality in Jordan Lake

  • Python:

    • GitHub repo: clone into your Jupyter environment
    • Notebook in HTML format

  • R:

    • Workspace Zip
    • Rmd in HTML format

• Part 4: R/Shiny example

  • In action: https://biogas-test.web.duke.edu
  • R-code: https://raw.githubusercontent.com/johnpfay/Biogas_viewer/master/app.R

► Video capture of Unit 3 → LINK