DScourseS24

KO | EN

gitlite — search

#javascript #python #react #ai #llm #rust #deep-learning #docker #windows #awesome #cli #awesome-list #pytorch #open-source

(★ 38)

Materials for Econ 5253 Data Science for Economists course at U of Oklahoma

DScourseS24 Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# ECON 5253: Data Science for Economists (Spring 2024) #

[![Join the chat at https://gitter.im/DScourseS24/community](https://badges.gitter.im/DScourseS24/community.svg)](https://app.gitter.im/#/room/!wChStqJuAGNdRzzJwr:gitter.im)

|  | [Tyler Ransom](http://tyleransom.github.io) |
|--------------|--------------------------------------------------------------|
| Email | [ransom@ou.edu](mailto:ransom@ou.edu) |
| Office | 322 CCD1 |
| Office Hours | Th 3:00pm-4:00pm and by appointment |
| GitHub | [tyleransom](https://github.com/tyleransom) |

* **Meeting day/time**: T,Th 1:30-2:45pm, CCD1, Room 338
* Office hours also available by appointment
* This course takes inspiration and extensively borrows materials from similar courses taught by [Jason DeBacker](https://github.com/jdebacker/CompEcon_Fall17) (U of South Carolina), [Rick Evans](https://github.com/rickecon/OGcourse_F17) (Rice U), and [Grant McDermott](https://github.com/uo-ec607/lectures) (U of Oregon). Thanks to them for providing a framework for using GitHub as a class collaboration tool and for insights into teaching programming skills.

## Course description ##

Data science is a rapidly developing field that combines the recent Big Data revolution with ever-developing statistical algorithms to inform business and policy decisions. Nearly every company you've heard of uses data science to optimize its services: Netflix uses it to recommend new programs to its viewers, Amazon uses it to determine how much it should charge for its Prime services. This class will provide students with an overview of the data science workflow, from collecting raw data to drawing a set of insights from which a decision maker can make informed decisions. Along the way we will broadly cover a variety of advances in data collection, data storage, visualization, machine learning and econometrics topics, as well as teaching and reinforcing good programming practices. The primary goal of this course is to provide you, the student, with a set of skills that will allow you to compete for a data science job.

## Course Objectives and Learning Outcomes ##

By the end of the course, students should be able to do the following:

1. Explain the data science workflow from start to finish
2. Be able to collect data from online sources via APIs or scraping
3. Describe similarities and differences between econometrics and machine learning
4. Explain what data science is, and how Big Data differs from other types of data
5. Demonstrate good programming practices by writing code that can allow for easy collaboration with others
6. Understand the differences between prediction and causality, and the cases in which each is useful

In this course students, through lecture and application, will learn about:
* Good programming practices, including how to write code collaboratively with others
* Software to increase research productivity including:
    * LaTeX/Markdown
    * git
* Software to collect & clean data, and estimate statistical models:
    * R
    * Julia
    * Python
* Software to manage big data sets:
    * SQL
    * RDDs (Resilient Distributed Datasets) --- Spark, Hadoop
* How to access and utilize cluster computing resources
    * SSH (Secure Shell)
    * SFTP (Secure File Transfer Protocol)
    * SLURM (Simple Linux Utility for Resource Management)
* Methods to gather and handle data including:
    * Costs and benefits of different data structures
    * Using APIs
    * Web scraping
* Best practices for cleaning and visualizing data
* Computational methods to:
    * Optimize and find roots of functions
    * Perform Monte Carlo simulations
    * Run computations in parallel using multiple processors (time permitting)
* Basics for modeling different types of data
* Machine learning basics:
    * Supervised vs. unsupervised learning
    * The five "tribes" of machine learning: how they are interconnected, and how they differ
    * Machine learning vs. econometrics: prediction vs. causality
    * Evaluating model performance
* Using economic models to inform policy decisions
    * Computing structural models

## Grades ##

Grades will be based on the categories listed below with the corresponding weights.

Component                    |   Percent  |
-----------------------------|------------|
Class Participation          |    10%     |
Problem Sets                 |    35%     |
Exam & Quizzes               |    20%     |
Final project                |    35%     |
**Total points**             |  **100%**  |

Final grades will be assigned according to the standard cutoffs (90%+ for an A, 80%-89.99% for a B, etc.).

* **Participation:**
    * An important part of learning is face-to-face interaction. Thus, some of your grade will depend on attendance and active participation in class meetings.
* **Problem sets:** will be assigned approximately weekly throughout the semester.
    * You must write and submit your own computer code, although I encourage you to collaborate with your fellow students. I **DO NOT** want to see a bunch of copies of identical code. I **DO** want to see each of you learning how to code these problems so that you could do it on your own.
    * Problem set solutions, both written and code portions, will be turned in via a pull request from your private [GitHub.com](https://github.com/) repository which is a fork of the class master repository on my account. (You will need to set up a GitHub account if you do not already have one.)
    * Written solutions must be submitted as PDF documents or Jupyter Notebooks.
    * Problem sets will be due on the day listed in the Daily Course Schedule section of this syllabus (see below) unless otherwise specified. Late problem sets will not receive any credit. Partially completed problem sets will receive partial credit.

* **Exam & Quizzes:**
    * We may periodically have in-class quizzes as low-stakes ways to get feedback
    * There will be an oral final exam, but no midterm exams

* **Final Project:**
    * Collect data on and analyze a research question of your choosing, using methods taught in this course
    * Write up a ~10 page (12pt font, double spaced, excluding References, Figures, and Tables) summary of your findings, including discussion about what prior studies of the same topic have found, as well as citations to prior studies
    * Turn in the written summary report and a GitHub repository containing all materials required to reproduce the results
    * Summary report should be written in LaTeX or RMarkdown and turned in as a PDF (source code for the summary report should also be included in your GitHub repository)
    * An example of what the final product should look like is [here](https://raw.githack.com/tyleransom/DScourseS24/master/FinalProject/ExampleProject.pdf), with LaTeX source code [here](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/ExampleProject.tex) and BibTeX source code [here](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/References.bib).
    * A detailed rubric for the final project is [here](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/README.md)

## Communication ##

* I will always be available via email, and via Zoom during office hours. Zoom link for office hours will be posted on Canvas.
* Additionally, I have set up a Gitter community (see the badge at the top of this document) where I am hoping you can chat with each other about programming or other questions you have regarding the course. I will also be a participant in that community.

## Daily Course Schedule ##
(Will be continuously updated throughout the semester)

| Date    | Day  | Topic | Due |
|-------- |----- |-------|-    |
| Jan 16  | T    | What is data science / big data / why is it important? ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/01-Intro/01slides.html)) | |
| Jan 18  | Th   | Git, GitHub, computing environment, and Coding best practices ([Notes on computing enviornment](https://github.com/tyleransom/DScourseS24/blob/master/LectureNotes/02-Productivity/README.md)); [Slides on Git](https://raw.githack.com/uo-ec607/lectures/master/02-git/02-Git.html#1) by Grant McDermott; [Slides on clean coding](https://raw.githack.com/OU-PhD-Econometrics/fall-2022/master/LectureNotes/01a-CleanCode/01aslides.html#1) by Tyler Ransom | Read Gentzkow & Shapiro's [handbook](https://web.stanford.edu/~gentzkow/research/CodeAndData.pdf); Ch. 1 of *The Master Algorithm*; register for GitHub account |
| Jan 23  | T    | Linux command line (Grant McDermott's [slides](https://raw.githack.com/uo-ec607/lectures/master/03-shell/03-shell.html#1)), SSH, accessing OSCER ([Notes](https://github.com/tyleransom/DScourseS24/blob/master/LectureNotes/03-CLI-Git/README.md)); Git Tutorial (p. 19 [here](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/03-CLI-Git/git_tutorial.pdf); adding upstream repositories [here](https://happygitwithr.com/upstream-changes.html)) | |
| Jan 25  | Th   | Overview of Data Scientists' tools ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/04-DS-Tools/04slides.html)) | [PS 1](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS1/PS1.pdf) |
| Jan 30  | T    | Using data: data types, storage ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/05-Using-Data/05slides.html)) | |
| Feb 1   | Th   | Big Data: SQL ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/06-SQL-RDD/06slides.html)) & RDDs ([link](https://spark.apache.org/docs/0.9.1/scala-programming-guide.html)) | |
| Feb 6   | T    | Sampling & storing Big Data ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/07-Spark/07slides.html)); running jobs on the OSCER cluster | [PS 2](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS2/PS2.pdf) |
| Feb 8   | Th   | Web scraping/APIs to gather data ([Grant McDermott's Lecture Notes](https://raw.githack.com/uo-ec607/lectures/master/06-web-css/06-web-css.html#1); [Ethics in Web Scraping](https://towardsdatascience.com/ethics-in-web-scraping-b96b18136f01?gi=cbd35737a79c); [rvest demonstration slides at 2018 useR conference](https://hanjostudy.github.io/Presentations/UseR2018/Rvest/rvest.html#1); [tidyverse cheat sheet](https://raw.githack.com/tyleransom/EconometricsLabs/master/tidyRcheatsheet.pdf); [Grant McDermott's Lecture Notes on R language basics](https://raw.githack.com/uo-ec607/lectures/master/04-rlang/04-rlang.html#1)) | |
| Feb 13  | T    | Web scraping/APIs to gather data ([Grant McDermott's Lecture Notes](https://raw.githack.com/uo-ec607/lectures/master/07-web-apis/07-web-apis.html#1)) | [PS 3](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS3/PS3.pdf) |
| Feb 15  | Th   | Intro to Julia ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/10-Julia/10slides.html); [Julia's "Learning Julia" page](https://julialang.org/learning/)) | |
| Feb 20  | T    | `ggplot2` ([Basics](https://rpubs.com/arvindpdmn/ggplot2-basics); [Kieran Healy's book](https://socviz.co/lookatdata.html)) | [PS 4](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS4/PS4.pdf) |
| Feb 22  | Th   | Getting to know your data: descriptive statistics, cleaning, tips, tricks, transformations, visualization ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/12-Data-Cleaning/12slides.html)) | |
| Feb 27  | T    | Modeling continuous and discrete variables ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/13-Modeling/13slides.html); [Simple R script](https://github.com/tyleransom/DScourseS24/blob/master/LectureNotes/13-Modeling/modelingBasics.R)) | |
| Feb 29  | Th   | Using JuMP to optimize cool stuff ([Jupyter Notebook](https://github.com/tyleransom/DScourseS24/blob/master/LectureNotes/14-JuMP/JuMPintro.ipynb); [Julia Code](https://github.com/tyleransom/DScourseS24/blob/master/LectureNotes/14-JuMP/JuMPintro.jl)) (in previous years: Linear Algebra Introduction / Review ([Handout](https://minireference.com/static/tutorials/linear_algebra_in_4_pages.pdf))) | |
| Mar 5   | T    | Introduction to optimization ([Notes](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/15-Opt-Intro/OptimizationIntro.pdf)) | [PS 5](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS5/PS5.pdf) |
| Mar 7   | Th   | Writing and optimizing functions in R, Python, and Julia ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/16_17-Opt/16_17slides.html)) | |
| Mar 12  | T    | Writing and optimizing functions in R, Python, and Julia ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/16_17-Opt/16_17slides.html)) | [PS 6](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS6/PS6.pdf) |
| Mar 14  | Th   | Debugging strategies and simulations ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/18-Simulation/18slides.html)) | |
| Mar 19  | T    | **No Class** (Spring Break) | |
| Mar 21  | Th   | **No Class** (Spring Break) | |
| Mar 26  | T    | Intro to Machine Learning ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/19-Intro-ML/19slides.html)) | [PS 7](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS7/PS7.pdf) |
| Mar 28  | Th   | Training and validating models with `tidymodels` ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/20-tidymodels/20slides.html)) | |
| Apr 2   | T    | Supervised ML: The 5 Tribes of Machine Learning ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/21-Five-Tribes/21slides.html)) | [PS 8](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS8/PS8.pdf) |
| Apr 4   | Th   | Unsupervised ML: Clustering ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/22_23-Unsupervised-ML/22_23slides.html)) | |
| Apr 9   | T    | Unsupervised ML: Dimensionality reduction and reinforcement learning ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/22_23-Unsupervised-ML/22_23slides.html)) | [PS 9](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS9/PS9.pdf) |
| Apr 11  | Th   | Machine learning vs. econometrics ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/24-ML-vs-Econometrics/24slides.html)) | |
| Apr 16  | T    | Discrete choice modeling: static discrete choice ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/25_26-Discrete-Choice/25_26slides.html)) | [PS 10](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS10/PS10.pdf) |
| Apr 18  | Th   | Discrete choice modeling: dynamic discrete choice ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/25_26-Discrete-Choice/25_26slides.html)) | |
| Apr 23  | T    | Strategies for more powerfully utilizing LLMs ([Slides](https://raw.githack.com/tyleransom/DScourseS24/master/LectureNotes/27-GPT/27slides.html)) | [PS 11](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS11/PS11.pdf) |
| Apr 25  | Th   | Final Project presentations ([Rubric](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/README.md)) | |
| Apr 30  | T    | Final Project presentations ([Rubric](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/README.md)) | |
| May 2   | Th   | Final Project presentations ([Rubric](https://github.com/tyleransom/DScourseS24/blob/master/FinalProject/README.md)) | [PS 12](https://raw.githack.com/tyleransom/DScourseS24/master/ProblemSets/PS12/PS12.pdf) |
| May 6   | M    | Final Exam (in class, 1:30-3:30pm) | Final project due ([Scoresheet](https://raw.githack.com/tyleransom/DScourseS24/master/FinalProject/Scoresheet.pdf)) |

## Helpful Links ##

* [QuantEcon](https://quantecon.org)
* [Notes on Machine Learning & Artificial Intelligence](https://chrisalbon.com) by Chris Albon
* [R data wrangling cheatsheet](https://www.rstudio.com/wp-content/uploads/2015/02/data-wrangling-cheatsheet.pdf)
* [R tidyverse](https://www.tidyverse.org)
* [Julia vs. Python for Data Science](https://www.infoworld.com/article/3241107/python/julia-vs-python-julia-language-rises-for-data-science.html)
* [Machine Learning "Mind Map"](https://raw.githack.com/dformoso/machine-learning-mindmap/master/Machine%20Learning.pdf)
* [JP Morgan massive overview of Big Data & Machine Learning](http://www.valuesimplex.com/articles/JPM.pdf)
* [Why it's becoming increasingly more difficult to learn to program](https://developers.slashdot.org/story/18/02/17/0947212/learning-to-program-is-getting-harder)

## Books ##

* The Master Algorithm ([Amazon link](https://www.amazon.com/Master-Algorithm-Ultimate-Learning-Machine-ebook/dp/B012271YB2))
* Julia for Data Science ([Amazon link](https://www.amazon.com/Julia-Data-Science-Zacharias-Voulgaris/dp/1634621301))
* R for Data Science ([Free PDF](http://r4ds.had.co.nz/))
* Data Science at the Command Line ([Free eBook](https://www.datascienceatthecommandline.com/))

## AI policy ##

You are allowed and encouraged to use artificial intelligence (AI) resources in all aspects of this course. This includes, but is not limited to, using AI to help you write code, to help you debug code, to help you find answers to questions, and to help you find data. You are also allowed and encouraged to use AI to help you with your problem sets and final project.

## University Policies ##

### Religious Observance ###

It is the policy of the University to excuse the absences of students that result from religious observances and to reschedule examinations and additional required classwork that may fall on religious holidays, without penalty.

### Reasonable Accommodation Policy ###

If a student requires an accommodation based on disability, the student should meet with me in my office during the first week of the semester. Student responsibility primarily rests with informing faculty at the beginning of the semester and in providing authorized documentation through designated administrative channels. The Disability Resource Center is located in the University Community Center at 730 College Avenue (405-325-3852).

### Academic Integrity: ###

I do not tolerate academic misconduct, [and neither does the University of Oklahoma](http://integrity.ou.edu/files/nine_things_you_should_know.pdf). I will not hesitate to fail students who do not fully comply with the University's academic misconduct policy. If you find yourself contemplating cheating, plagiarism, or other forms of academic misconduct, please come see me first. Help is available if you are struggling. I want everyone in the class to try their best and to do their own work. Please be advised that I reserve the right to utilize anti-plagiarism resources such as TurnItIn when grading assignments.

### Title IX Resources and Reporting Requirement ###

For any concerns regarding gender-based discrimination, sexual harassment, sexual assault, dating/domestic violence, or stalking, the University offers a variety of resources. To learn more or to report an incident, please contact the Sexual Misconduct Office at (405) 325-2215 (8 to 5, M-F) or [smo@ou.edu](mailto:smo@ou.edu). Incidents can also be reported confidentially to OU Advocates at (405) 615-0013 (phones are answered 24 hours a day, 7 days a week). Also, please be advised that a professor/GA/TA is required to report instances of sexual harassment, sexual assault, or discrimination to the Sexual Misconduct Office. Inquiries regarding non-discrimination policies may be directed to: Bobby J. Mason, University Equal Opportunity Officer and Title IX Coordinator at (405) 325-3546 or [bjm@ou.edu](mailto:bjm@ou.edu). For more information, visit http://www.ou.edu/eoo.html.

### Adjustments for Pregnancy/Childbirth Related Issues ###

Should you need modifications or adjustments to your course requirements because of documented pregnancy-related or childbirth-related issues, please contact your professor or the Disability Resource Center at (405) 325-3852 as soon as possible. Also, see http://www.ou.edu/eoo/faqs/pregnancy-faqs.html for answers to commonly asked questions.

### Reasonable Accommodations for Students with Disabilities ###

DScourseS24

DScourseS24 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

DScourseS24

DScourseS24 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README