Skip to content

Latest commit

 

History

History

bench

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
all_character-long
all_character-long
 
 
all_character-wide
all_character-wide
 
 
all_numeric-long
all_numeric-long
 
 
all_numeric-wide
all_numeric-wide
 
 
fwf
fwf
 
 
taxi
taxi
 
 
taxi_multiple
taxi_multiple
 
 
taxi_writing
taxi_writing
 
 
.gitignore
.gitignore
 
 
GNUmakefile
GNUmakefile
 
 
README.md
README.md
 
 
all_character-long.tsv
all_character-long.tsv
 
 
all_character-wide.tsv
all_character-wide.tsv
 
 
all_numeric-long.tsv
all_numeric-long.tsv
 
 
all_numeric-wide.tsv
all_numeric-wide.tsv
 
 
download-data.sh
download-data.sh
 
 
fwf.tsv
fwf.tsv
 
 
run-bench-fwf.R
run-bench-fwf.R
 
 
run-bench.R
run-bench.R
 
 
script.sh
script.sh
 
 
session_info.R
session_info.R
 
 
session_info.tsv
session_info.tsv
 
 
summarise-benchmarks.R
summarise-benchmarks.R
 
 
taxi.tsv
taxi.tsv
 
 
taxi_multiple.tsv
taxi_multiple.tsv
 
 
taxi_writing.tsv
taxi_writing.tsv
 
 

README.md

Benchmarks for vroom

The benchmarks are run with a makefile, run make to run them.

Personal notes on running benchmarks on AWS

Starting up

  • Create new volume from previous vroom snapshot - io1 volume type - 2500 IOPS
  • Attach volume to instance - /dev/sda1

Attach to instance

ssh vroom-bench

When you first start there may be some unattended upgrades installing, use top to monitor and wait until they are done.

running

make -j 1 \
  TAXI_INPUTS='$(wildcard ~/data/trip_fare*csv)'  \
  FWF_INPUT=~/data/PUMS5_06.TXT \
  BENCH_LONG_ROWS=1000000 \
  BENCH_LOG_COLS=25 \
  BENCH_WIDE_ROWS=100000 \
  BENCH_WIDE_COLS=1000

Tearing down

  • Shut down instance
  • Detach volume
  • Create snapshot
  • Delete volume