sagemaker-graph-entity-resolution

KO | EN

gitlite — search

#javascript #python #react #ai #llm #golang #rust #deep-learning #linux #cli #kubernetes #vue #ios #open-source

sagemaker-graph-entity-resolution

(★ 17)

No description available.

sagemaker-graph-entity-resolution Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Entity Resolution for Smart Advertising using Amazon SageMaker

This project shows how to use [Deep Graph Library (DGL)](https://www.dgl.ai/) on [Amazon SageMaker](https://aws.amazon.com/sagemaker/) to train a graph neural network (GNN) model to perform entity resolution on customer identity graphs. See the project detail page to learn more about the techniques used.

## Getting Started

You will need an AWS account to use this solution. Sign up for an account [here](https://aws.amazon.com/).

To run this JumpStart 1P Solution and have the infrastructure deploy to your AWS account you will need to create an active SageMaker Studio instance (see [Onboard to Amazon SageMaker Studio](https://docs.aws.amazon.com/sagemaker/latest/dg/gs-studio-onboard.html)). When your Studio instance is *Ready*, use the instructions in [SageMaker JumpStart](https://docs.aws.amazon.com/sagemaker/latest/dg/studio-jumpstart.html) to 1-Click Launch the solution.

The solution artifacts are included in this GitHub repository for reference.

*Note*: Solutions are available in most regions including us-west-2, and us-east-1.

**Caution**: Cloning this GitHub repository and running the code manually could lead to unexpected issues! Use the AWS CloudFormation template. You'll get an Amazon SageMaker Notebook instance that's been correctly setup and configured to access the other resources in the solution.

## Architecture
The project architecture deployed by the cloud formation template is shown here.

![](https://raw.githubusercontent.com/awslabs/sagemaker-graph-entity-resolution/master/deployment/arch_dark.png)

## Contents

* `deployment/`
  * `sagemaker-graph-entity-resolution.yaml`: Creates AWS CloudFormation Stack for solution
* `source/`
  * `lambda/`
    * `data-preprocessing/`
      * `index.py`: Lambda function script for invoking SageMaker processing
    * `graph-modelling/` 
      * `index.py`: Lambda function script for invoking SageMaker training
  * `sagemaker/`
    * `data-preprocessing/`
      * `data_preparation_script.py`: Custom script used to prepare CIKM cup data to solution input format
      * `data_preprocessing_script.py`: Custom script used by SageMaker Processing for data processing/feature engineering
    * `dgl-entity-resolution/`
      * `model.py`: Implements the various graph neural network models used in the project with the pytorch backend
      * `data.py`: Contains functions for reading edges and node features
      * `estimator_fns.py`: Contains functions for parsing input from SageMaker estimator objects
      * `graph.py`: Contains functions for constructing DGL Graphs with node features and edge lists
      * `requirements.txt`: Describes Python package requirements of the Amazon SageMaker training instance
      * `sampler.py`: Contains functions for graph sampling for mini-batch training
      * `train_dgl_pytorch_entry_point.py`: python entry point used by the notebook for GNN training with DGL pytorch backend
      * `utils.py`: python script with utility functions for computing metrics and plots
    * `dgl-entity-resolution.ipynb`: Orchestrates the solution. Triggers preprocessing and model training

## License

This project is licensed under the Apache-2.0 License.

sagemaker-graph-entity-resolution

sagemaker-graph-entity-resolution Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

sagemaker-graph-entity-resolution

sagemaker-graph-entity-resolution Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README