PyTorch-Adventures
This repository contains an exhaustive coverage of a hands on approach to PyTorch along side powerful tools to accelerate model tuning and training
파일 탐색기
최종 버전 다운로드 (.zip)- Book 1 - The Philosopher's Stone.txt
- Book 2 - The Chamber of Secrets.txt
- Book 3 - The Prisoner of Azkaban.txt
- Book 4 - The Goblet of Fire.txt
- Book 5 - The Order of the Phoenix.txt
- Book 6 - The Half Blood Prince.txt
- Book 7 - The Deathly Hallows.txt
- .gitignore
- AlexNet.py
- AutoEncoder.py
- AutoEncoderKL.py
- CycleGan.py
- DCGAN.py
- GPT.py
- LSTMSequenceModeling.py
- MaskedAutoEncoder.py
- ResNet.py
- RoBERTa.py
- Seq2Seq.py
- UnconditionalDiffusion.py
- UperNet.py
- VAE_simple.py
- VisionTransformer.py
- VQAutoEncoderKL.py
- VQVAE_simple.py
- Wav2Vec2.py
- accelerate.py
- gpt2.py
- resnet.py
- launch.py
- __init__.py
- cross_entropy.py
- dropout.py
- flash_attention.py
- layernorm.py
- softmax.py
- utils.py
- __init__.py
- _deprecated_recursive_functional.py
- _deprecated_recursive_modules.py
- functional.py
- initializations.py
- modules.py
- __init__.py
- lr_scheduler.py
- optimizers.py
- __init__.py
- data.py
- grad_processor.py
- __init__.py
- _array.py
- dtypes.py
- ops.py
- sampling.py
- save_load.py
- tensor.py
- prepare_owt.py
- prepare_owt.sh
- prepare_shakespeare.py
- prepare_shakespeare.sh
- train_conv_cifar10_classifier.sh
- train_tiny_gpt2.sh
- banner.png
- all_reduce_test_w_launch.py
- all_reduce_test_wo_launch.py
- all_reduce_w_launch.sh
- all_reduce_wo_launch.sh
- run_ddp_mnist.sh
- train_ddp_mnist.py
- train_conv1d_mnist_autoencoder.py
- train_conv2d_cifar10_classifier.py
- train_conv2d_mnist_autoencoder.py
- train_linear_mnist_classifier.py
- train_resnet_classifier.py
- inference_gpt2.py
- README.md
- requirements.txt
- train_gpt2.py
- train_gpt2.sh
- Backpropagation.pdf
- nn.py
- optim.py
- README.md
- regression_learning.gif
- train_character_transformer.py
- train_conv_classifier.py
- train_linear_classifier.py
- train_linear_classifier_slow.py
- train_linear_classifier_w_softmax.py
- train_linear_regressor.py
- train_pytorch_character_transformer.py
- nn.py
- optim.py
- train_char_transformer.py
- README.md
- README.md
- Transfer Learning.ipynb
- ddp.py
- Distributed Training.ipynb
- README.md
- README.md
- submit_train.sh
- train.py
- utils.py
- Intro to PyTorch.ipynb
- README.md
- rgb_tensor.png
- DataLoaders.ipynb
- README.md
- discrete_fourier_transform.py
- discrete_wavelet_transform.py
- fast_fourier_transform.py
- linear_predictive_coding.py
- mel_frequency_cepstral_coefficients.py
- mel_spectrogram.py
- pitch_detection.py
- short_time_fourier_transform.py
- ctc_loss_figure.png
- ctc.py
- README.md
- config.yaml
- config_maestro.yaml
- chinese_reconstruction.png
- code_usage.png
- french_reconstruction.png
- gen_spectrogram.png
- limit_books.png
- per_book.png
- __init__.py
- conv.py
- discriminator.py
- encodec.py
- gather_test_.py
- lstm.py
- quantizer.py
- seanet.py
- snake.py
- english_sample.wav
- reconstructions_codebooks_to_0.wav
- reconstructions_codebooks_to_1.wav
- reconstructions_codebooks_to_2.wav
- reconstructions_codebooks_to_2_to_8.wav
- reconstructions_codebooks_to_3.wav
- reconstructions_codebooks_to_4.wav
- reconstructions_codebooks_to_5.wav
- reconstructions_codebooks_to_6.wav
- reconstructions_codebooks_to_7.wav
- chinese_reconstruction.wav
- chinese_sample.wav
- french_reconstruction.wav
- french_sample.mp3
- english_reconstruction.wav
- english_sample.wav
- compare_needed_codes.py
- measure_code_utilization.py
- plot_spectrogram_results.py
- balancer.py
- build_dataset.py
- dataset.py
- inference.py
- loss.py
- prep_maestro.py
- README.md
- run.py
- tokenize_audio.py
- trainer.py
- utils.py
- dataset.py
- finetune.sh
- inference.ipynb
- loss.py
- model.py
- README.md
- save_taco_mels.py
- save_taco_mels.sh
- tacotron2.py
- tokenizer.py
- train.py
- train.sh
- intro_to_audio_processing.ipynb
- README.md
- sample_audio.flac
- deepspeech2.ipynb
- README.md
- dataset.py
- inference.ipynb
- model.py
- prep_splits.py
- README.md
- tokenizer.py
- train_taco.py
- train_taco.sh
- prepare_data.sh
- sample_audio.wav
- compute_durations.py
- dataset.py
- finetune.sh
- finetune_wav2vec2.py
- inference.ipynb
- model.py
- pretrain.sh
- pretrain_wav2vec2.py
- README.md
- utils.py
- PyTorch for Vision.ipynb
- README.md
- masking.py
- model.py
- pretrain.py
- pretrain.sh
- mae_reconstruction.png
- seg1.png
- seg2.png
- classifier_utils.py
- finetune_classifier.py
- finetune_classifier.sh
- finetune_mae_classification.py
- finetune_segmentation.py
- MAE_UperNet_ADE20K_Results.ipynb
- MaskedAutoEncoder.py
- plot_reconstructions.ipynb
- pretrain.sh
- pretrain_mae.py
- README.md
- sample_image.png
- segmentation_utils.py
- UperNet.py
- utils.py
- VisionTransformer.py
- README.md
- ResNet.ipynb
- __init__.py
- dataloader.py
- model.py
- README.md
- UNET for Semantic Segmentation.ipynb
- UNET_ADE20K_Results.ipynb
- unet_train_ade20k.py
- attn.png
- classifier.png
- cls_pos_embed.png
- layernorm.png
- mha.png
- mha_proj.png
- patch_embeddings.png
- prod_w_val.png
- projection.png
- training_curve_noaug.png
- training_curve_waug.png
- model.py
- README.md
- submit.sh
- train.py
- Transformers Visualized.pdf
- utils.py
- VisionTransformer.ipynb
- gumbel_softmax_quantizer.ipynb
- Intro_To_AutoEncoders.ipynb
- models.py
- README.md
- Residual_Vector_Quantizer.ipynb
- utils.py
- Variational_AutoEncoders.ipynb
- Vector_Quantized_Variational_AutoEncoders.ipynb
- model.py
- scaling_autoencoders_and_results.ipynb
- train_vae.py
- train_vqvae.py
- gen.png
- pixel_cnn_model.py
- README.md
- run.sh
- train.py
- pixel_rnn_model.py
- run.sh
- train.py
- example_gen.png
- README.md
- conditional_diffusion_process.png
- sample_gen_1.png
- sample_gen_2.png
- inference.ipynb
- model.py
- README.md
- scheduler.py
- submit.sh
- train.py
- step_50000.png
- sample_image.png
- Diffusion.ipynb
- README.md
- submit.sh
- train.py
- option1.png
- option2.png
- ref.png
- ldm.yaml
- stage1_vae_train.yaml
- stage1_vae_train_cc.yaml
- stage1_vqvae_train.yaml
- stage2_diffusion_train.yaml
- imagenet_class_prompt.txt
- imagenet_classes.txt
- sample_text_cond_prompts.txt
- __init__.py
- config.py
- discriminator.py
- embeddings.py
- layers.py
- ldm.py
- losses.py
- mylpips.py
- scheduler.py
- transformer.py
- unet.py
- vae.py
- cc_vae.png
- celeb_vae.png
- celeb_vae_nopercep.png
- celeb_vqvae.png
- imagenet_vae.png
- cafe.png
- celeba1.png
- celeba2.png
- celeba3.png
- cozy_cabin.png
- forest.png
- futuristic_city.png
- sunset_beach.png
- watermarked.png
- compute_vae_scaling.sh
- prep_cc.sh
- stage1_vae_cc_32x32x4.sh
- stage1_vae_celebahq_32x32x4.sh
- stage1_vqvae_celebahq_32x32x4.sh
- stage2_diffusion.sh
- train_lpips.sh
- .gitignore
- compute_vae_scaling.py
- dataset.py
- discriminator.py
- download_cc.sh
- inference_ldm.py
- inference_vae.py
- lpips_trainer.py
- prep_cc.py
- README.md
- sample_image.png
- stage1_vae_trainer.py
- stage1_vqvae_trainer.py
- stage2_diffusion_trainer.py
- tests.py
- utils.py
- dataset.py
- model.py
- README.md
- sample_gen.png
- simple_cyclegan.ipynb
- train.py
- utils.py
- deep_convolutional_gan.ipynb
- README.md
- conditional_generation.png
- gen.gif
- Intro to Gans.ipynb
- README.md
- dataset.py
- loss.py
- model.py
- train.py
- constrained_optimization.png
- primal_dual.png
- README.md
- wasserstein_gan.ipynb
- clip.py
- inference.py
- README.md
- train.py
- train.sh
- GPT Causal Language Modeling.ipynb
- README.md
- data_utils.py
- finetune.sh
- finetune_sft.py
- gen.gif
- inference.py
- inference.sh
- prepare_pretrain_data.py
- prepare_pretrain_data.sh
- prepare_sft.sh
- prepare_sft_data.py
- pretrain.py
- pretrain.sh
- README.md
- tokenizer.py
- model.py
- README.md
- Harry Potter Writer.ipynb
- README.md
- README.md
- Sequence Classification.ipynb
- ppo_trainer.py
- reward_trainer.py
- compute_squad_score.sh
- evaluate_squad_score.py
- finetune.sh
- finetune_roberta_qa.py
- inference.py
- inference_mlm.ipynb
- model.py
- prepare.sh
- prepare_data.py
- pretrain.sh
- pretrain_roberta.py
- README.md
- RoBERTa Masked Language Modeling.ipynb
- utils.py
- google_translate.png
- .gitignore
- compute_bleu.py
- data.py
- inference.ipynb
- model.py
- prepare_data.py
- README.md
- tokenizer.py
- train.py
- ddpg-mountaincar-episode-0.mp4
- ddpg.ipynb
- a2c.ipynb
- run.py
- run.sh
- policy-network-episode-0.mp4
- gae_paper_fig.png
- generalized_advantage_estimation.ipynb
- run.py
- run.sh
- stationary_dist.gif
- policy-network-episode-0.mp4
- policy_networks.ipynb
- policy-network-episode-0.mp4
- ppo.ipynb
- policy-network-baseline-episode-0.mp4
- reinforce_with_baseline.ipynb
- policy-network-episode-0.mp4
- a_ortho.png
- cg.png
- cg_proc.png
- local_approx.png
- trust_region.png
- trpo.ipynb
- policy-network-episode-0.mp4
- actor_critic.ipynb
- q_learning_stable-episode-0.mp4
- q_learning_unstable-episode-0.mp4
- sample-episode-0.mp4
- deep_q_learning.ipynb
- double_q_learning_stable-episode-0.mp4
- double_deep_q_learning.ipynb
- dueling_q_learning_stable-episode-0.mp4
- dueling_deep_q_learning.ipynb
- dueling_q_learning_stable-episode-0.mp4
- slow_per_dueling_q_learning_stable-episode-0.mp4
- array_setup.png
- bench.png
- graph_update.png
- start_12.png
- step1_12.png
- step1_3.png
- step2_12.png
- step2_3.png
- tree.png
- var_graph.png
- prioritized_experience_replay.ipynb
- sumtree_bench.py
- sumtree_per.ipynb
- intro_rl_and_policy_iter.ipynb
- value_iteration.ipynb
- algb_manip.png
- monte_carlo.ipynb
- q_learning.ipynb
- sarsa.ipynb
- td_lambda.ipynb
- td_n.ipynb
- README.md
- README.md
- attention_mechanism.ipynb
- README.md
- flops_comparison.png
- model.py
- prepare.sh
- prepare_data.py
- pretrain.sh
- pretrain_roberta.py
- profile_attention.py
- README.md
- utils.py
- windowed_attention.py
- README.md
- README.md
- inference.ipynb
- lora.py
- README.md
- train_text_classifier.py
- train_vit_image_classifier.py
- qlora.py
- train_llama_text_classifier.py
- train_resnet_image_classifier.py
- train_roberta_text_classifier.py
- train_vit_image_classifier.py
- activation_functions.png
- additive_vs_concat_residual.png
- ade20k_unet_prediction.png
- AE_Embeddings.gif
- alexnet_architecture.png
- all_vae_gens_on_digit.png
- att_mat.png
- attention_is_all_you_need.png
- attention_mechanism_visual.png
- autoencoder_visual.png
- autoencoder_vs_unet.png
- backprop_vis.png
- backpropthroughtime.png
- banner.png
- BERT_archtiecture.png
- bit_depth.jpg
- block_window_attention.png
- causal_masking.png
- celeba_diffusion.png
- classifier.png
- clm_figure.png
- computational_graph_1.png
- computational_graph_2.png
- computing_attention.png
- concatenateheads.png
- conditional_gan.png
- conv_feature_extracts.jpeg
- cross_attention_mat_vals.png
- cross_attention_matmul.png
- cross_attention_padding.png
- cross_attention_weight_by_val.png
- cross_atttenion_qkv.png
- CycleGAN.png
- dcgan_implementation.png
- decoder_attention_vis.png
- deepspeech2.png
- dense_network.png
- diffusion.png
- dl_normalizations.png
- dropout.png
- dueling_deep_q.png
- easynet.png
- embed_cls.png
- encodec_model.png
- encoder_attention_vis.png
- feedforward.png
- frozen_lake.gif
- frozen_lake_actions.png
- frozen_lake_policy_example.png
- frozen_lake_rewards.png
- frozen_lake_states.png
- Fully_connected_Recurrent_Neural_Network.gif
- gan_backprop.png
- gan_diagram.png
- grad_descent.png
- gumbel_max_trick.png
- gumbel_softmax_quantization.png
- hifigan_architecture.png
- im2col.gif
- image_causality.png
- intersection_over_union.png
- kmeans.png
- kmeans_clustering.png
- layernorm.png
- ldm_architecture.png
- linear_autoencoder_embeddings.gif
- linear_regression.jpg
- llama4.png
- logistic_curve.png
- lora.png
- lunarlander.gif
- mae.png
- masked_language_modeling_vis.png
- minibatchgraddesc.png
- mlm_attention.png
- mp4_compression_ibm_visual.png
- mult_w_v.png
- multihead.png
- multiheaded_attention_visual.png
- my_unet.png
- nn_mnist_visual.png
- no_padding_no_strides.gif
- no_padding_no_strides_transposed.gif
- norm_softmax.png
- optimal_transport.png
- original_unet.png
- overfitting_underfitting.jpg
- padding_attention_mask.png
- patchembedding.png
- pca_visual.png
- pixel_cnn.png
- pixel_rnn.png
- pixel_rnn_maskA.png
- pixelcnn.png
- play_button.png
- play_button_small.png
- projection.png
- recurrent_neural_network_diagram.png
- reparamaterization_trick.png
- residual_block.png
- residuals_performance.png
- ResNetArchitecture.png
- rgb_tensor.png
- rl_banner.png
- rnn-vs-lstm.png
- rnn_input_output_setups.png
- rnn_rolled_unrolled.png
- rnn_with_attention.png
- rvq.png
- rvq_process.gif
- same_padding_no_strides.gif
- sequence_padding.png
- single_headed_attention_visual.png
- sliding_window_attention.png
- sobel_wiki_orig.jpg
- sobel_wiki_output.jpg
- stacked.png
- taco_mel_gen.gif
- tacotron2_diagram.png
- Typical_cnn.png
- uncompact_vanilla_autoencoder_latents.png
- Unet.png
- unfolded_multilayer_lstm.png
- upernet_head.png
- VAE_Embeddings.gif
- vanilla_autoencoder_latent_interpolation.png
- variational_autoencoder.png
- vqvae.png
- VQVAE_Embeddings.gif
- wav2vec2_architecture.png
- weighted_average.png
- x_logo.png
- download_carvana.sh
- .gitignore
- download_data.sh
- LICENSE
- prep_data.py
- README.md
- requirements.txt
# 설치 가이드
1. 코드 내려받기
git clone https://github.com/priyammaz/PyTorch-Adventures
깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.
cd PyTorch-Adventures
방금 내려받은 프로젝트 폴더 안으로 이동합니다.
2. Python
쉬움 추천사전 준비물
pip install -r Neural Networks from Scratch/AutoGrad/requirements.txt
requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.
jupyter notebook
브라우저에서 노트북(.ipynb) 파일들을 열람하고 실행할 수 있는 Jupyter 화면을 켭니다.
에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.
// repository documentation
Was this content helpful?
(0 ratings)
