Growling-Cat

KO | EN

gitlite — search

#python #hacktoberfest #ai #typescript #android #linux #java #windows #awesome #cli #kubernetes #vue #pytorch #openai

(★ 22)

An Open Source Screaming Frog Alternative

Growling-Cat Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Growling Cat - SEO Crawler 🐈

</div>

[![Docker Image CI](https://github.com/Umair-khurshid/Growling-Cat/actions/workflows/docker-image.yml/badge.svg)](https://github.com/Umair-khurshid/Growling-Cat/actions/workflows/docker-image.yml)
[![Pylint](https://github.com/Umair-khurshid/Growling-Cat/actions/workflows/pylint.yml/badge.svg)](https://github.com/Umair-khurshid/Growling-Cat/actions/workflows/pylint.yml)

</div>

Growling Cat is a open-source SEO crawler designed as a cross-platform alternative to Screaming Frog. It efficiently scrapes
and analyzes web pages, providing valuable insights into SEO elements, internal linking, and broken links.

## Features
   - SEO Data Extraction: Fetches titles, meta descriptions, headings, images, and structured data.
   - Crawl Depth Control: Adjust the depth of internal link crawling.
   - JavaScript Rendering (Optional): Uses Selenium for JavaScript-heavy pages.
   - Broken Link Detection: Identifies broken internal links.
   - Customizable Settings: Control concurrency, download delays, and rendering options.

## Installation
  **1. Clone the repository:**

```
   git clone git@github.com:Umair-khurshid/Growling-Cat.git
   cd Growling-Cat
   ```
 **2. Install dependencies:**
  ```
  pip install -r requirements.txt
  ```
## Usage
  There are three ways to run Growling Cat:

**1. Streamlit UI (Recommended)**
  This is the easiest way to use Growling Cat.
 ```
 streamlit run app.py
 ```
 You can also use the demo at: [Growling Cat](https://growling-cat.streamlit.app/)

**2. Command-Line Interface**
  You can also run the crawler from the command line:

```
 python cli.py <url> <depth> <delay> <concurrency> <js_rendering>
 ```
 Example:

```
 python cli.py https://quotes.toscrape.com/ 2 0.5 8 False
```
 **3. Docker**
  You can run the Streamlit UI in a Docker container.
 ```
 docker build -t growling-cat .
 docker run -p 8501:8501 growling-cat
```

## Troubleshooting
  Some websites have strong anti-scraping protections. If a crawl fails or returns no results, try the following:
   - Increase Download Delay: In the "Advanced Settings," increase the download delay to 2-3 seconds to avoid being
     rate-limited.
   - Reduce Concurrency: Lower the number of concurrent requests to 1 or 2.
   
 *Note: Some sites may still be difficult to crawl even with these adjustments.*

Growling-Cat

Growling-Cat Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Growling-Cat

Growling-Cat Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README