← categories / category

Web Content Scrapers

See on ruby-toolbox ↗ Tools designed to extract and process data from websites efficiently

recent from @rubygems

horsefield

It's a scraper

  • 0.7.1 May 17 2025 gem.coop system

kimurai

Modern web scraping framework written in Ruby and based on Capybara/Nokogiri

  • 2.2.0 Jan 27 2026 gem.coop system

sinew

Sinew - structured web crawling using recipes.

  • 4.0.1 Aug 19 2023 gem.coop system

tanakai

Maintained fork of Kimurai, a modern web scraping framework written in Ruby and based on Capybara/Nokogiri

  • 1.7.5 Feb 10 2025 gem.coop system

wiki-api

MediaWiki API and Page content parser for Headlines (nested), TextBlocks, ListItems, and Links.

  • 0.1.2 Dec 20 2023 gem.coop system

wombat

Ruby DSL to scrape web pages

  • 3.4.0 Oct 27 2026 gem.coop system

older from @rubygems

anemone

Anemone web-spider framework

  • 0.7.2 May 30 2012 gem.coop system

arachnid2

A simple, fast web crawler

  • 0.4.0 Jul 15 2020 gem.coop system

boilerpipe-ruby

A pure ruby implementation of the boilerpipe web content extraction algorithm

  • 0.5.0 Feb 15 2021 gem.coop system

cobweb

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites faster than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

  • 1.2.1 Jan 09 2021 gem.coop system

data_miner

Download, pull out of a ZIP/TAR/GZ/BZ2 archive, parse, correct, and import XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models.

  • 3.0.0.rc2 Aug 28 2013 gem.coop system

docparser

DocParser is a Ruby Gem for webscraping

  • 0.3.0 Apr 13 2020 gem.coop system

fletcher

A cross-website product/model information fetcher.

  • 0.6.9 May 12 2014 gem.coop system

link_thumbnailer

Ruby gem ranking images from a given URL returning an object containing images and website informations.

  • 3.4.0 Jul 24 2020 gem.coop system

metainspector

MetaInspector is a ruby gem for web scraping purposes, that returns metadata from a given URL

  • 5.9.0 Jan 21 2020 gem.coop system

pismo

Extracts or retrieves content-related metadata from HTML pages

  • 0.7.4 Feb 27 2013 gem.coop system

url_scraper

A simple plugin for extracting information from url entered by user (Something like what facebook does). This gem is built on top of opengraph gem created by michael bleigh.

  • 0.0.5 Jul 23 2013 gem.coop system