xidel

(★ 843)

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Owner Repos

internettools ★ 135

XPath/XQuery 3.1 interpreter for Pascal with compatibility modes for XPath 2.0/XQuery 1.0/3.0, custom and JSONiq extensions, pattern matching, XML/HTML/JSON parsers and classes for HTTP/S requests

Pascal
treelistview ★ 57

A Pascal treelistview component, showing a treeview together with the columns of a listview (for Delphi and Lazarus)

Pascal
nasty-files ★ 48

Some files with nasty names
videlibri ★ 47

:books: Cross-platform library client to automate any OPAC and library catalog from your local device, e.g. for renewing of borrowed books or searching for books available in the library in automated scripts.

HTML
bbutils ★ 45

A bunch of important low-level functions missing in FreePascal, e.g. string or array manipulation functions.

Pascal
rcmdline ★ 40

Advanced command line parser for Pascal

Pascal

File Explorer

ZIP Download
  • .hgtags
  • .travis.yml
  • _hg.filemap
  • build.sh
  • cgi.css
  • cgi.js
  • changelog
  • COPYING
  • install.sh
  • manage.sh
  • printUsage.inc
  • README.md
  • readme.txt
  • xidel.lpi
  • xidel.pas
  • xidelbase.pas
  • xidelcgi.lpi
  • xidelcgi.lpr
  • xidelcrt.pas

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Link
Example

Command Glossary

Commands referenced in this DOCs, explained below.

🔍

xidel

View Details ▼

Download and extract data from HTML/XML pages as well as JSON APIs.

xidel {{https://www.google.com/search?q=test}} {{[-e|--extract]}} "//a/extract(@href, 'url[?]q=([^&]+)&', 1)[. != '']"

Print all URLs found by a Google search:

xidel {{https://www.google.com/search?q=test}} {{[-f|--follow]}} "{{//a/extract(@href, 'url[?]q=([^&]+)&', 1)[. != '']}}" {{[-e|--extract]}} {{//title}} --download '{{{$host}/}}'

Print the title of all pages found by a Google search and download them:

xidel {{https://example.org}} {{[-f|--follow]}} {{//a}} {{[-e|--extract]}} {{//title}}

Follow all links on a page and print the titles, with XPath:

// repository documentation