Skip to content

Flag usage in WikAPIdia

Matt Lesicko edited this page Jul 25, 2013 · 4 revisions

pipeline

  • all
  • download
  • dump
  • wikitext
  • concept
  • analysis

Env

  • -c configuration file
  • -h number of threads
  • -l languages
  • -n name of concept mapper algorithm

ConceptLoader

  • -d drop and recreate all tables
  • -n name of concept mapper algorithm

DumpLoader

  • -d drop and recreate all tables

LuceneLoader

  • -d drop and recreate all indexes
  • -i the type of indexes to store
  • -p namespaces

PhraseLoader

  • -p phrase analyzer to use

RedirectLoader

  • -d drop and recreate all tables

UniversalLinkLoader

  • -d drop and recreate all tables
  • -n name of concept mapper algorithm

WikiTextLoader

  • -d drop and recreate all tables

MetricTrainer

  • -g datasets
  • -m local metric
  • -r max results
  • -u universal metric to use

RequestedLinkGetter

  • -o output path
  • -f names of file types
  • -y date

filedownloader.sh

  • -o output path
  • -t tsv to read download links from
Clone this wiki locally