VFedPCA-VFedAKPCA

KO | EN

gitlite — search

#react #ai #typescript #go #machine-learning #deep-learning #linux #nodejs #windows #awesome #kubernetes #awesome-list #mcp #ios

VFedPCA-VFedAKPCA

(★ 12)

Source Code & Datasets for "Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data"

VFedPCA-VFedAKPCA 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# VFedPCA+VFedAKPCA: Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data
This is the official source code for the Paper: **[Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data](https://arxiv.org/abs/2203.01752)**.

Please cite our paper if you find our code or paper useful:
```bibtex
@article{cheung2022vertical,
  title={Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data},
  author={Cheung, Yiu-ming and Jiang, Juyong and Yu, Feng and Lou, Jian},
  journal={arXiv preprint arXiv:2203.01752},
  year={2022}
}
```

## Paper Abstract
Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset setting. This paper will study the unsupervised FL under the vertically partitioned dataset setting. Accordingly, we propose the federated principal component analysis for vertically partitioned dataset (VFedPCA) method, which reduces the dimensionality across the joint datasets over all the clients and extracts the principal component feature information for downstream data analysis. We further take advantage of the nonlinear dimensionality reduction and propose the vertical federated advanced kernel principal component analysis (VFedAKPCA) method, which can effectively and collaboratively model the nonlinear nature existing in many real datasets. In addition, we study two communication topologies. The first is a server-client topology where a semi-trusted server coordinates the federated training, while the second is the fully-decentralized topology which further eliminates the requirement of the server by allowing clients themselves to communicate with their neighbors. Extensive experiments conducted on five types of real-world datasets corroborate the efficacy of VFedPCA and VFedAKPCA under the vertically partitioned FL setting.

## Server-Clients Architecture

 <img src="figs/server_client.png" alt="Server-Clients Architecture" width="400">
 
 Figure 1.: Server-Clients Architecture

## Master Branch
```
VFedPCA+VFedAKPCA                    
└── case                        // Case Studies
    └── figs                    // Save experimental results' figures in '.eps' / '.png' format 
        ├── img_name*.eps              
        └── img_name*.png           
    ├── main.py          
    ├── model.py              
    └── utils.py                 
├── dataset                     // Put downloaded dataset in this folder
└── figs                        // Save experimental results' figures in '.eps' / '.png' format
    ├── img_name*.eps              
    └── img_name*.png           
├── README.md               
├── main.py                     // Experiment on Structured Dataset
├── model.py                   
└── utils.py                     
```

## Environments

- python = 3.8.8
- numpy = 1.20.1
- pandas = 1.2.4
- scipy = 1.6.2
- scikit-learn = 0.24.1
- imageio = 2.9.0

## Prepare Dataset
To demonstrate the superiority of our method, we utilized FIVE types of real-world datasets coming with distinct nature.  
1) structured datasets from different domains; 
2) medical image dataset; 
3) face image dataset; 
4) gait image dataset;
5) person re-identification image dataset.

**Step 1: Download Dataset from the [Google Drive URL](https://drive.google.com/drive/folders/1Rv_a02tBygvbO8FY05XxsY_lhXLiHQj6?usp=sharing)**

**Step 2: Specify Dataset Path by Command Argument**

```bash
$ python main.py --data_path="./dataset/xxx"
```

## Experiments
We conduct extensive experiments on structured datasets to exmaines the effect of feature size, local iterations, warm-start power iterations, and weight scaling method on structed datasets. Furthermore, we investigate some case studies with image dataset to demonstrate the effectiveness of VFedPCA and VFedAKPCA.

### A. Experiment on Structured Dataset
The example is as follows. More details command usage can be check by `python main.py --help`.

```bash
$ python main.py --data_path './dataset/College.csv' /
                 --p_list [3, 5, 10] /
                 --iter_list [10, 10, 10] /
                 --period_num 10 /
                 --sample_num 777 # use the whole by default
```
### B. Experiment on Synethetic Dataset
The example is as follows. More details command usage can be check by `python main.py --help`.

```bash
$ python main.py --synthetic / # start use synthetic dataset
                 --pattern mixture / # or single
                 --shape [20000, 4000] # M features x N samples
```

### C. Case Studies
The example is as follows. More details command usage can be check by `python main.py --help`.

```bash
$ cd case # change into case folder
$ python main.py --data_path '../dataset/Image/DeepLesion' /
                 --client_num 8 / 
                 --iterations 100 / 
                 --re_size 512 /
                 --kernel sigmoid
```
# Demo Visualization
The experimental result on structured datasets (GlaucomaM), the distance error after multiple communication has been significantly reduced and converge compared with the un-communicated situation at 0-th period.

<img src="figs/GlaucomaM.png" alt="Server-Clients Architecture" width="600">
 
 Figure 2. The results of VFedPCA on structured datasets (GlaucomaM).

Here is some of our case studies comparative experiment results on six image datasets: YaleFace (center-light and surprised), CasiaGait (sequence 1 and sequence 10), DeepLesion and CUHK03 (from left to right), as shown in Figure 3.

<img src="figs/pca_akpca.png" alt="Server-Clients Architecture" width="600">
 
 Figure 3. The results of PCA(a)/AKPCA(b) on the un-splitted data, VFedPCA(a)/VFedAKPCA(b) on the isolated data, VFedAvgPCA(a)/VFedAvgAKPCA(b) (Without Weight Scaling Method) on the isolated data, PCA(a)/AKPCA(b) on the isolated data (from top to bottom).

Furthermore, we investigate three types of decentralized topologies in Vertical Federated Learning with PCA and AKPCA (ours). The architecture of decentralized topologies are (a) Fully Decentralized, (b) Ring Decentralized, and (c) Star Decentralized, as shown in Figure 4. The experimental results are demonstrated in Figure 5.

<img src="figs/dec_topo.png" alt="Server-Clients Architecture" width="600">
 
 Figure 4. The three different types of decentralized topology.

<img src="figs/dec_pca_akpca.png" alt="Server-Clients Architecture" width="600">
 
 Figure 5. The results of VFedPCA with the central coordination server, fully decentralized, ring decentralized, and start decentralized, from top to bottom respectively, on the isolated data from each clients.

VFedPCA-VFedAKPCA

VFedPCA-VFedAKPCA 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

VFedPCA-VFedAKPCA

VFedPCA-VFedAKPCA 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README