concept_discovery_svd

KO | EN

gitlite — search

#javascript #react #typescript #android #machine-learning #linux #macos #nodejs #windows #awesome #vue #pytorch #mcp #open-source

concept_discovery_svd

(★ 14)

Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantically distinct meaning.

concept_discovery_svd 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Contributors][contributors-shield]][contributors-url]
[![Forks][forks-shield]][forks-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
[![MIT License][license-shield]][license-url]
[![LinkedIn][linkedin-shield]][linkedin-url]

<br />
<p align="center">
  <a href="https://github.com/othneildrew/Best-README-Template">
    <img src="images/overview.png" alt="Logo" width="800" >
  </a>

<h3 align="center">Uncovering Unique Concept Vectors through Latent Space Decomposition</h3>

<p align="center">
   Source code for the paper in TMLR 2023.  
    Perform concept discovery in the latent space of deep learning models with Singular Value Decomposition. 
    <br />
    <a href="https://github.com/maragraziani/concept_discovery_svd/blob/master/notebooks/ExampleNotebook.ipynb">View Demo</a>
    ·
    <a href="https://github.com/maragraziani/concept_discovery_svd/issues">Report Bug</a>
  </p>
</p>

<details open="open">
  <summary>Supported Models</summary>
  <ol>
    <li>
      <a href="#about-the-project">State-of-the-art CNNs</a>
      <ul>
        <li>Inception V3</li>
      </ul>
      <ul>
        <li>ResNet 50</li>
      </ul>
        </li>
      <li>
    MLP for tabular data
  </ol>
</details>
<details open="open">
  <summary>Datasets</summary>
  <ol>
    <li>
      <a href="https://www.image-net.org/">ImageNet</a>
      <ul>
        <li><a href="https://github.com/fastai/imagenette">ImageWoof</a></li>
      </ul>
      <ul>
        <li><a href="https://github.com/fastai/imagenette">Imagenette</a></li>
      </ul>
    </li>
    <li>
      <a href="https://open-xai.github.io/">XAI Benchmark</a>
      <ul>
        <li><a href="https://www.propublica.org/datastore/dataset/compas-recidivism-risk-score-data-and-analysis">COMPAS</a></li>
      </ul>
    </li>
  </ol>
</details>

## About CDISCO

This repo contains the implementation of the CDISCO toolkit proposed in the paper "Uncovering Unique Concept Vectors through Latent Space Decomposition", published in Transactions in Machine Learning Research in 2023.

Achieving broader interpretability with concept vectors requires a reverse engineering approach that focuses on automating concept identification. The central question here is: Given a representation of a complex model such as its deep latent space spanned by individual neurons, is this already an interpretable version? If not, can we find a different description of this space that aligns with semantically distinct and unique concepts?
We propose to analyze the latent space of a deep neural network with Singular Value Decomposition, to discover a new representation of the space that best describes "what the model has learnt". 
This novel framework merges factorization, clustering of the latent space and output-sensitivity analyses. As a result, we are able to isolate directions in the latent space that respond to well-distinguishable, unique concepts.

### Functionalities

CDISCO can be used to identify the singular vectors, to visualize concept maps and to analyze the model internal state.

CDISCO - main tool
```sh
   import cdisco.cdisco
   ```
* to implement - run_cdisco(model, input_data, save_fold='') -> runs get_model_state() and then discovery()
* discovery(conv_maps, gradients, prediction, classes) -> concept_candidates, eigenvectors
* get_model_state(model, input_data, save_fold='') -> performs inference on input_data and stores the output in save_fold

CDISCO - vis tool

The visualization toolbox allows us to visualize and interpret the results of CDISCO. 
```sh
   import cdisco.vis
   ```
* cdisco.vis.cdisco_concept_vis(image_path, concept_vector, conv_maps) -> concept_heatmap
* cdisco.vis.cdisco_vis_extremes_extensive(concepts_list, concept_candidates, eigenvectors, conv_maps, input_paths, predictions, save_fold='') -> visualizes the top 5 images that have the highest projection on the concept direction and saves it in save_fold
* cdisco.vis.conceptbard(concept, save_fold='') -> saves in save_fold a visualization of the cncept segmentations to create a board that is representative of the concept

CDISCO - analyze tool

```sh
   import cdisco.analyze
   ```
  
  * cdisco.analyze.cdisco_alignment(concepts, concept_candidates) -> prints the list of classes that share the same discovered concept direction 
  * cidsco.analyze.cdisco_pop_concepts(concept_candidates, classes, eigenvectors, save_fold='')-> prints the top 3 most popular directions among the classes
  * cdisco.analyze.cdisco_angle_dissection(eigenvectors, candidates, save_fold='')-> stores in savefold the results of the alignment evaluation of each concept with the canonical basis. 
  
  
### Built With

This section should list any major frameworks that you built your project using. Leave any add-ons/plugins for the acknowledgements section. Here are a few examples.
* [Python3.6](https://getbootstrap.com)
* [PyTorch](https://jquery.com)

## Getting Started

Follow the steps below to install the toolkit as a github repo. Pip install will be implemented soon.

### Installation

1. Clone this repo
   ```sh
   git clone https://github.com/maragraziani/CDISCO.git
   ```
2. Install required packages
   ```sh
   pip install -r requirements.txt
 

## License

Distributed under the MIT License. See `LICENSE` for more information.

## Contact

Mara Graziani - [@mormontre](https://twitter.com/mormontre) - mara.graziani@hevs.ch

[contributors-shield]: https://img.shields.io/github/contributors/maragraziani/cdisco.svg?style=for-the-badge
[contributors-url]: https://github.com/maragraziani/concept_discovery_svd/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/maragraziani/cdisco.svg?style=for-the-badge
[forks-url]: https://github.com/maragraziani/cdisco/network/members
[stars-shield]: https://img.shields.io/github/stars/maragraziani/cdisco.svg?style=for-the-badge
[stars-url]: https://github.com/maragraziani/cdisco/stargazers
[issues-shield]: https://img.shields.io/github/issues/maragraziani/cdisco?style=for-the-badge
[issues-url]: https://github.com/maragraziani/cdisco/issues
[license-shield]: https://img.shields.io/github/license/maragraziani/cdisco.svg?style=for-the-badge
[license-url]: https://github.com/maragraziani/cdisco/blob/master/LICENSE.txt
[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555
[linkedin-url]: https://www.linkedin.com/in/mara-graziani-878980105/?originalSubdomain=ch
[product-screenshot]: images/screenshot.png

concept_discovery_svd

concept_discovery_svd 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

concept_discovery_svd

concept_discovery_svd 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README