Neural-Crawler-Web-Crawler

(★ 92)

BFS and DFS BASED Project.A neural network-powered web crawler that intelligently extracts, classifies, and processes web content using deep learning

오너의 다른 레포

Python-Programming-Basics-For-Artificial-Intelligence ★ 110

This Python folder is a structured learning workspace that documents my progress from beginner to more advanced programming concepts through daily practice projects.

Python
Multi-Agent-Book-Writer ★ 95

A collaborative AI system where multiple specialized agents work together to plan, write, edit, and refine complete books.

Python
Parallel-and-Distributed-Computing ★ 89

Parallel and distributed computing are techniques to improve speed and handle large-scale tasks by dividing problems into smaller parts. Parallel computing uses multiple processors in one system (shared memory) for simultaneous computation, while distributed computing connects multiple independent computers (network) to act as one system.

Jupyter Notebook
100-AI-Agents-independent-projects ★ 87

You’ll begin by building practical personal productivity agents . From there, you’ll move into writing, research, and analysis agents that generate content, summarize complex information, and extract insights from data. As the course progresses, you’ll build business-focused agents for operations, marketing, HR, legal, finance.

Python
MCP-powered-Agentic-RAG ★ 87

An MCP-powered agentic RAG system that transcribes, indexes, and intelligently queries audio content using advanced retrieval-augmented generation.

Python
EimanTahir027 ★ 22

Config files for my GitHub profile.I’m a developer focused on building practical, reliable software and improving user experiences. I enjoy working with modern web technologies and turning ideas into clean, maintainable solutions.

파일 탐색기

ZIP 다운로드
  • .gitattributes
  • app.py
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • crawler_runner.py
  • LICENSE
  • output.json
  • README.md
  • scrapy.cfg

# CDN으로 사용하기

jsDelivr

jsDelivr는 공개 GitHub 리포지토리를 별도 설정 없이 CDN으로 즉시 서빙합니다. 버전과 파일을 고르면 웹페이지에 바로 붙일 수 있는 링크와 예시 코드가 만들어집니다.

링크
예시

명령어 용어집

이 문서에서 사용된 명령어를 모아봤습니다. 낯선 명령어가 있다면 펼쳐서 확인해보세요.

🔍

git checkout

설명 보기 ▼

Checkout a branch or paths to the working tree.

git checkout -b {{branch_name}}

Create and switch to a new branch:

git checkout -b {{branch_name}} {{reference}}

Create and switch to a new branch based on a specific reference (branch, remote/branch, tag are examples of valid references):

git checkout {{branch_name}}

Switch to an existing local branch:

🔍

git clone

설명 보기 ▼

Clone an existing repository.

git clone {{remote_repository_location}} {{path/to/directory}}

Clone an existing repository into a new directory (the default directory is the repository name):

git clone --recursive {{remote_repository_location}}

Clone an existing repository and its submodules:

git clone {{[-n|--no-checkout]}} {{remote_repository_location}}

Clone only the `.git` directory of an existing repository:

🔍

git commit

설명 보기 ▼

Commit files to the repository.

git commit

Open an editor to write a message and commit staged files to the repository:

git commit {{[-m|--message]}} "{{message}}"

Commit staged files to the repository with the specified message:

git commit {{[-F|--file]}} {{path/to/commit_message_file}}

Commit staged files with a message read from a file:

🔍

git push

설명 보기 ▼

Push commits to a remote repository.

git push

Send local changes in the current branch to its default remote counterpart:

git push {{remote_name}} {{local_branch}}

Send changes from a specific local branch to its remote counterpart:

git push {{[-u|--set-upstream]}} {{remote_name}} {{local_branch}}

Send changes from a specific local branch to its remote counterpart, and set the remote one as the default push/pull target of the local one:

🔍

pip install

설명 보기 ▼

Install Python packages.

pip install {{package1 package2 ...}}

Install one or more packages:

pip install {{package1 package2 ...}} {{[-U|--upgrade]}}

Upgrade all specified packages to the latest version, installing any that are not already present:

pip install {{package}}=={{version}}

Install a specific version of a package:

🔍

python

설명 보기 ▼

Python 언어 인터프리터.
더 많은 정보: <https://docs.python.org/using/cmdline.html>.

python

REPL(대화형 셸) 시작:

python {{path/to/file.py}}

특정 Python 파일 실행:

python -i {{path/to/file.py}}

특정 Python 파일 실행 후 REPL 시작:

🔍

scrapy

설명 보기 ▼

웹 크롤링 프레임워크.
더 많은 정보: <https://docs.scrapy.org/en/latest/topics/commands.html#using-the-scrapy-tool>.

scrapy startproject {{project_name}}

프로젝트 생성:

scrapy genspider {{spider_name}} {{website_domain}}

스파이더 생성 (프로젝트 디렉토리에서):

scrapy edit {{spider_name}}

스파이더 편집 (프로젝트 디렉토리에서):

// repository documentation