newerhoods

KO | EN

gitlite — search

#hacktoberfest #react #ai #typescript #llm #go #linux #docker #windows #cli #vue #pytorch #openai #open-source

(★ 40)

A Data Clinic project that aggregates NYC Open Data at the tract-level and uses Machine Learning techniques to re-imagine neighborhood boundaries.

newerhoods Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

**This project and corresponding website are no longer maintained by Two Sigma. We continue to encourage independent development.**

# NewerHoods

New York City’s (NYC’s) neighborhoods are a driving force in the lives of New Yorkers—their identities are closely intertwined and a source of pride. However, the history and evolution of NYC’s neighborhoods don’t follow the rigid, cold lines of statistical and administrative boundaries. Instead, the neighborhoods we live and work in are the result of a more organic confluence of factors.

Data Clinic developed NewerHoods with the goal of helping individuals and organizations better advocate for their communities by enabling them to tailor insights to meet their specific needs. NewerHoods is an interactive web-app that uses open data to generate localized features at the census tract-level and machine learning to create homogeneous clusters. Users are able to select characteristics of interest (currently open data on housing, crime, and 311 complaints), visualize NewerHood clusters on an interactive map, find similar neighborhoods, and compare them against existing administrative boundaries.  The tool is designed to enable users without in-depth data expertise to compare and incorporate these redefined neighborhoods into their work and life.

The application is live and available to use [here](https://newerhoods.tsdataclinic.com/).

### Getting Started
The below steps will help you get started and setting up and running NewerHoods locally. Since this is a RShiny application, install RStudio on your machine if you haven't already from [here](https://www.rstudio.com/products/RStudio/#Desktop).

#### Directory Structure

`newerhoods/clean_data` contains just the cleaned/transformed data sets used directly by the Shiny App.

`/src` contains all the code to merge and clean the data sets, extract features from it, and cluster the features.

`/newerhoods` contains the code for the RShiny WebApp.

#### Running the App

First, the R environment needs to be set up with all the necessary packages.

```r
source("newerhoods/setup.R")
```

The project uses several APIs from loading data using the APIs developed by NYC Developer Portal and Mapbox for the underlying map visualization in the Shiny App. Getting all of these token are free by signing up [here](https://developer.cityofnewyork.us/) and [here](https://www.mapbox.com/). Follow the instructions in the `settings.R` file which can be found in the `newerhoods` folder and source the local version of the file to get all the tokens stored in the environment. You would have to source this settings file everytime you start a new session.

*Note: If you intend to run only the RShiny App, filling in just the MapBox API Token would suffice.*

```r
source("newerhoods/settings_local.R")
```

Run the App
```r
library(shiny)
runApp("newerhoods")
```
Alternatively, you can run the application in docker. To build the docker container run

```bash
docker build -t newerhoods . 
```

Then to run the docker container simply run

```bash
docker run -it --rm -p 3000:3000 -v $(pwd):/app newerhoods 
```

any changes you make in the code should trigger an application reload so all you should need to do is refresh your browser to see them.

### Contributing to NewerHoods

We invite [feedback](https://airtable.com/shr2sLGHHIiLY6BUC) on the tool and encourage users to contribute. Check out [this page](https://github.com/tsdataclinic/newerhoods/blob/master/CONTRIBUTING.md) for some ways in which you can contribute. To contact [Data Clinic](https://www.twosigma.com/about/data-clinic/) about NewerHoods, please email us at dataclinic@twosigma.com.

### Data Sources

1. [NYC Annualized Property Sales Data (2012-2017)](https://www1.nyc.gov/site/finance/taxes/property-annualized-sales-update.page)
2. [MapPLUTO (18v1)](https://www1.nyc.gov/site/planning/data-maps/open-data/dwn-pluto-mappluto.page)
3. [Geoclient API v1.1](https://developer.cityofnewyork.us/api/geoclient-api)
4. [Property Assessment Roll Archives](https://www1.nyc.gov/site/finance/taxes/property-assessment-roll-archives.page)
5. [NYPD Complaint Data Historic](https://data.cityofnewyork.us/Public-Safety/NYPD-Complaint-Data-Historic/qgea-i56i)
6. [311 Service Requests from 2010 to Present](https://data.cityofnewyork.us/Social-Services/311-Service-Requests-from-2010-to-Present/erm2-nwe9)
7. [NYC 2010 Census Tracts](https://data.cityofnewyork.us/City-Government/2010-Census-Tracts/fxpq-c8ku)

### References

1. [ClustGeo: an R package for hierarchical clustering with spatial constraints](https://arxiv.org/abs/1707.03897) 
2. [Making Neighborhoods - Understanding New York City Transitions 2000-2010](http://chpcny.org/assets/MakingNeighborhoodsPaper.pdf)

### License
This project is licensed under the Apache 2.0 License - see the LICENSE.md file for details

newerhoods

newerhoods Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

newerhoods

newerhoods Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README