wikitabletocsv

Convert tables on wikipedia pages to a CSV file.

Other solutions

I find these solutions not to be satisfactory to my needs:

• http://wikitable2csv.ggor.de works fine, but doesn't merge tables, and can't be used in CLI
• https://bitbucket.org/JanKanis/wiki2csv requires to download the page, doesn't extract text from links

Therefore, I'm doing my own!

Requirements

• python2.7 (probably works with other versions too)
• BeautifulSoup4 (used for HTML traversing and text extraction)

Installation

Clone or download.

$ pip install -r requirements.txt

Usage

$ ./tabletocsv.py --help
usage: tabletocsv.py [-h] [--class-name CLASS_NAME] url [dest]

positional arguments:
  url         Source of data. Expects to contain one or more <table> elements
              with specified class name.
  dest        The file to write output to. Omit or use '-' to write to stdout.

optional arguments:
  -h, --help  show this help message and exit
  --class-name CLASS_NAME
              CSS class name for the tables to search for. (Without dot, just
              name.) (default: wikitable)

Caveats

Is only guaranteed to work on this Wiki page. I haven't tried any other.

There's no real input validation either. Use with care.