big-file-uploader

KO | EN

gitlite — search

#javascript #typescript #llm #go #golang #android #machine-learning #deep-learning #docker #nodejs #vue #security #ios #openai

big-file-uploader

(★ 15)

A sample project to upload big files by chunking them and uploading the chunks concurrently.

big-file-uploader 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Requirements
1. File should be uploaded in chunks. Chunks can be uploaded in any order. File can be of any type.
2. Chunk size should be configurable.
3. There are multiple server instances running on different addresses. Each server knows about every other server. Chunk received on one server should be replicated to other servers so that each server can have the chunk.
4. Chunks received on servers should be stitched in correct order to maintain the integrity of the file.

# Design Approach
1. Chunk size and a list of servers can be saved in some config file and this file will be read on application startup.

2. An http endpoint will be there to accept a chunk with additional information like offset, agent, total no of chunks that needs to be received, identifier corresponding to this particular file upload.

3. Once a server instance receives a chunk, it will distribute this chunk to other servers only if the agent is client. 
On receiving this chunk, server will
    1. Write this chunk to the file with that identifier at the required offset.
    2. Evaluate if all the chunks have been received. If yes it will return an appropriateg response.

# To Run
## Run two build files in two terminals as follows:
1. ./build-1.sh
2. ./build-2.sh

## To Run from client specify the file to be uploaded in config.yml
1. cd client
2. go run main.go

## Curl to upload file
curl --location --request POST '127.0.0.1:3001/file' \
--form 'file=@/home/use/filename'

## Dummy-UI
a dummy ui to upload file can be accessed at : http://127.0.0.1:3001/index

### Sample upload using React 
![Alternate UI](https://github.com/atulkgupta9/big-file-uploader/raw/master/static/img/img.gif)

big-file-uploader

big-file-uploader 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

big-file-uploader

big-file-uploader 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README