tidyexplain - GitLite

KO | EN

gitlite — search

#python #llm #go #android #machine-learning #rust #java #windows #cli #awesome-list #security #ios #openai #open-source

tidyexplain

(★ 797)

🤹‍♀ Animations of tidyverse verbs using R, the tidyverse, and gganimate

파일 탐색기

최종 버전 다운로드 (.zip)

- CODEOWNERS
- anti-join.gif
- full-join.gif
- inner-join.gif
- intersect.gif
- left-join-extra.gif
- left-join.gif
- right-join.gif
- semi-join.gif
- setdiff-rev.gif
- setdiff.gif
- tidyr-pivoting.gif
- tidyr-spread-gather.gif
- union-all.gif
- union-rev.gif
- union.gif
- 00_base_join.R
- 00_base_set.R
- 00_base_tidyr.R
- 01_register-fonts.R
- 02_functions.R
- 03_check-folders.R
- anti_join.R
- full_join.R
- inner_join.R
- intersect.R
- left_join.R
- left_join_extra.R
- right_join.R
- semi_join.R
- setdiff.R
- tidyr_pivoting.R
- tidyr_spread_gather.R
- union.R
- union_all.R
- .gitignore
- activate.R
- settings.dcf
.gitignore
.Rprofile
deps.R
LICENSE
README.md
README.Rmd
renv.lock
tidy-animated-verbs.Rproj

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Tidy Animated Verbs

[![CC0](https://img.shields.io/badge/license_(images)_-CC0-green.svg)](https://creativecommons.org/publicdomain/zero/1.0/)
[![MIT](https://img.shields.io/badge/license_(code)_-MIT-green.svg)](https://opensource.org/licenses/MIT)

Garrick Aden-Buie – [@grrrck](https://twitter.com/grrrck) –
[garrickadenbuie.com](https://www.garrickadenbuie.com)

**Thanks to contributions from …**

-   [Tyler Grant Smith](https://github.com/TylerGrantSmith) contributed
    set operations animations.
-   [Lukas Wallrich](https://github.com/LukasWallrich) and [Kelsey
    Gonzalez](https://github.com/kelseygonzalez) helped create
    animations of tidyr’s pivoting functions.

**Animations:**

-   [**Mutating Joins**](#mutating-joins) —
    [`inner_join()`](#inner-join), [`left_join()`](#left-join),
    [`right_join()`](#right-join), [`full_join()`](#full-join)

-   [**Filtering Joins**](#filtering-joins) —
    [`semi_join()`](#semi-join), [`anti_join()`](#anti-join)

-   [**Set Operations**](#set-operations) — [`union()`](#union),
    [`union_all()`](#union-all), [`intersect()`](#intersection),
    [`setdiff()`](#set-difference)

-   [**Tidy Data**](#tidy-data) — [`pivot_wider()` and
    `pivot_longer()`](#pivot-wider-and-longer), [`spread()` and
    `gather()`](#spread-and-gather)

-   Learn more about

-   [Using the animations and images](#usage)
    -   [Relational Data](#relational-data)
    -   [gganimate](#gganimate)

## Background

### Usage

Please feel free to use these images for teaching or learning about
action verbs from the [tidyverse](https://tidyverse.org). You can
directly download the [original animations](images/) or static images in
[svg](images/static/svg/) or [png](images/static/png/) formats, or you
can use the [scripts](R/) to recreate the images locally.

Currently, the animations cover the [dplyr two-table
verbs](https://dplyr.tidyverse.org/articles/two-table.html) and I’d like
to expand the animations to include more verbs from the tidyverse.
[Suggestions are
welcome!](https://github.com/gadenbuie/tidy-animated-verbs/issues)

### Relational Data

The [Relational Data](http://r4ds.had.co.nz/relational-data.html)
chapter of the [R for Data Science](http://r4ds.had.co.nz/) book by
Garrett Grolemund and Hadley Wickham is an excellent resource for
learning more about relational data.

The [dplyr two-table verbs
vignette](https://dplyr.tidyverse.org/articles/two-table.html) and Jenny
Bryan’s [Cheatsheet for dplyr join
functions](http://stat545.com/bit001_dplyr-cheatsheet.html) are also
great resources.

### gganimate

The animations were made possible by the newly re-written
[gganimate](https://github.com/thomasp85/gganimate#README) package by
[Thomas Lin Pedersen](https://github.com/thomasp85) (original by [Dave
Robinson](https://github.com/dgrtwo)). The [package
readme](https://github.com/thomasp85/gganimate#README) provides an
excellent (and quick) introduction to gganimate.

### Dynamic Animations

Thanks to an initial push by [David
Zimmermann](https://github.com/DavZim), we have begun work towards
functions that generate dynamic animations from users’ actual data.
Please visit the [pkg
branch](https://github.com/gadenbuie/tidyexplain/tree/pkg) of the
tidyexplain repository for more information (or to contribute!).

## Mutating Joins

> A mutating join allows you to combine variables from two tables. It
> first matches observations by their keys, then copies across variables
> from one table to the other.  
> [R for Data Science: Mutating
> joins](http://r4ds.had.co.nz/relational-data.html#mutating-joins)

<img src="images/static/png/original-dfs.png" width="480px" />

``` r
x
#> # A tibble: 3 × 2
#>      id x    
#>   <int> <chr>
#> 1     1 x1   
#> 2     2 x2   
#> 3     3 x3
y
#> # A tibble: 3 × 2
#>      id y    
#>   <int> <chr>
#> 1     1 y1   
#> 2     2 y2   
#> 3     4 y4
```

### Inner Join

> All rows from `x` where there are matching values in `y`, and all
> columns from `x` and `y`.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/inner-join.gif)

``` r
inner_join(x, y, by = "id")
#> # A tibble: 2 × 3
#>      id x     y    
#>   <int> <chr> <chr>
#> 1     1 x1    y1   
#> 2     2 x2    y2
```

### Left Join

> All rows from `x`, and all columns from `x` and `y`. Rows in `x` with
> no match in `y` will have `NA` values in the new columns.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/left-join.gif)

``` r
left_join(x, y, by = "id")
#> # A tibble: 3 × 3
#>      id x     y    
#>   <int> <chr> <chr>
#> 1     1 x1    y1   
#> 2     2 x2    y2   
#> 3     3 x3    <NA>
```

### Left Join (Extra Rows in y)

> … If there are multiple matches between `x` and `y`, all combinations
> of the matches are returned.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/left-join-extra.gif)

``` r
y_extra # has multiple rows with the key from `x`
#> # A tibble: 4 × 2
#>      id y    
#>   <dbl> <chr>
#> 1     1 y1   
#> 2     2 y2   
#> 3     4 y4   
#> 4     2 y5
left_join(x, y_extra, by = "id")
#> # A tibble: 4 × 3
#>      id x     y    
#>   <dbl> <chr> <chr>
#> 1     1 x1    y1   
#> 2     2 x2    y2   
#> 3     2 x2    y5   
#> 4     3 x3    <NA>
```

### Right Join

> All rows from y, and all columns from `x` and `y`. Rows in `y` with no
> match in `x` will have `NA` values in the new columns.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/right-join.gif)

``` r
right_join(x, y, by = "id")
#> # A tibble: 3 × 3
#>      id x     y    
#>   <int> <chr> <chr>
#> 1     1 x1    y1   
#> 2     2 x2    y2   
#> 3     4 <NA>  y4
```

### Full Join

> All rows and all columns from both `x` and `y`. Where there are not
> matching values, returns `NA` for the one missing.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/full-join.gif)

``` r
full_join(x, y, by = "id")
#> # A tibble: 4 × 3
#>      id x     y    
#>   <int> <chr> <chr>
#> 1     1 x1    y1   
#> 2     2 x2    y2   
#> 3     3 x3    <NA> 
#> 4     4 <NA>  y4
```

## Filtering Joins

> Filtering joins match observations in the same way as mutating joins,
> but affect the observations, not the variables. … Semi-joins are
> useful for matching filtered summary tables back to the original rows.
> … Anti-joins are useful for diagnosing join mismatches.  
> [R for Data Science: Filtering
> Joins](http://r4ds.had.co.nz/relational-data.html#filtering-joins)

### Semi Join

> All rows from `x` where there are matching values in `y`, keeping just
> columns from `x`.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/semi-join.gif)

``` r
semi_join(x, y, by = "id")
#> # A tibble: 2 × 2
#>      id x    
#>   <int> <chr>
#> 1     1 x1   
#> 2     2 x2
```

### Anti Join

> All rows from `x` where there are not matching values in `y`, keeping
> just columns from `x`.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/anti-join.gif)

``` r
anti_join(x, y, by = "id")
#> # A tibble: 1 × 2
#>      id x    
#>   <int> <chr>
#> 1     3 x3
```

## Set Operations

> Set operations are occasionally useful when you want to break a single
> complex filter into simpler pieces. All these operations work with a
> complete row, comparing the values of every variable. These expect the
> x and y inputs to have the same variables, and treat the observations
> like sets.  
> [R for Data Science: Set
> operations](http://r4ds.had.co.nz/relational-data.html#set-operations)

<img src="images/static/png/original-dfs-set-ops.png" width="480px" />

``` r
x
#> # A tibble: 3 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a    
#> 2 1     b    
#> 3 2     a
y 
#> # A tibble: 2 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a    
#> 2 2     b
```

### Union

> All unique rows from `x` and `y`.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/union.gif)

``` r
union(x, y)
#> # A tibble: 4 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a    
#> 2 1     b    
#> 3 2     a    
#> 4 2     b
```

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/union-rev.gif)

``` r
union(y, x)
#> # A tibble: 4 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a    
#> 2 2     b    
#> 3 1     b    
#> 4 2     a
```

### Union All

> All rows from `x` and `y`, keeping duplicates.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/union-all.gif)

``` r
union_all(x, y)
#> # A tibble: 5 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a    
#> 2 1     b    
#> 3 2     a    
#> 4 1     a    
#> 5 2     b
```

### Intersection

> Common rows in both `x` and `y`, keeping just unique rows.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/intersect.gif)

``` r
intersect(x, y)
#> # A tibble: 1 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     a
```

### Set Difference

> All rows from `x` which are not also rows in `y`, keeping just unique
> rows.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/setdiff.gif)

``` r
setdiff(x, y)
#> # A tibble: 2 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 1     b    
#> 2 2     a
```

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/setdiff-rev.gif)

``` r
setdiff(y, x)
#> # A tibble: 1 × 2
#>   x     y    
#>   <chr> <chr>
#> 1 2     b
```

## Tidy Data

[Tidy data](http://r4ds.had.co.nz/tidy-data.html#tidy-data-1) follows
the following three rules:

1.  Each variable has its own column.
2.  Each observation has its own row.
3.  Each value has its own cell.

Many of the tools in the [tidyverse](https://tidyverse.org) expect data
to be formatted as a tidy dataset and the
[tidyr](https://tidyr.tidyverse.org) package provides functions to help
you organize your data into tidy data.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/static/png/original-dfs-tidy.png)

``` r
wide
#> # A tibble: 2 × 4
#>      id x     y     z    
#>   <int> <chr> <chr> <chr>
#> 1     1 a     c     e    
#> 2     2 b     d     f
long
#> # A tibble: 6 × 3
#>      id key   val  
#>   <int> <chr> <chr>
#> 1     1 x     a    
#> 2     2 x     b    
#> 3     1 y     c    
#> 4     2 y     d    
#> 5     1 z     e    
#> 6     2 z     f
```

### Pivot Wider and Longer

`pivot_wider()` and `pivot_longer()` were introduced in [tidyr version
1.0](https://www.tidyverse.org/blog/2019/09/tidyr-1-0-0/#pivoting)
(released in September 2019). They provide a more consistent and more
powerful approach to changing the fundamental shape of the data and are
“modern alternatives to `spread()` and `gather()`.

Here we show the very basic mechanics of pivoting, but there’s much more
that the pivot functions can do. You can learn more about them in the
[Pivoting vignette in
tidyr](https://tidyr.tidyverse.org/articles/pivot.html).

``` r
pivot_wider(data, names_from = key, values_from = val)
```

> `pivot_wider()` “widens” data, increasing the number of columns and
> decreasing the number of rows.

``` r
pivot_longer(data, cols = x:y, names_to = "key", values_to = "val")
```

> `pivot_longer()` “lengthens” data, increasing the number of rows and
> decreasing the number of columns.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/tidyr-pivoting.gif)

### Spread and Gather

``` r
spread(data, key, value)
```

> Spread a key-value pair across multiple columns. Use it when an a
> column contains observations from multiple variables.

``` r
gather(data, key = "key", value = "value", ...)
```

> Gather takes multiple columns and collapses into key-value pairs,
> duplicating all other columns as needed. You use `gather()` when you
> notice that your column names are not names of variables, but *values*
> of a variable.

![](https://raw.githubusercontent.com/gadenbuie/tidyexplain/main/images/tidyr-spread-gather.gif)

``` r
gather(wide, key, val, x:z)
#> # A tibble: 6 × 3
#>      id key   val  
#>   <int> <chr> <chr>
#> 1     1 x     a    
#> 2     2 x     b    
#> 3     1 y     c    
#> 4     2 y     d    
#> 5     1 z     e    
#> 6     2 z     f
spread(long, key, val)
#> # A tibble: 2 × 4
#>      id x     y     z    
#>   <int> <chr> <chr> <chr>
#> 1     1 a     c     e    
#> 2     2 b     d     f
```