Bible Data Tools

This repository contains tools to download and process Bible chapter data.

1. Downloading Chapters (fetch_bible.py)

This script downloads Bible chapters from BibleGateway concurrently and saves them as structured JSON files.

Requirements

• Python 3.7+
• aiohttp
• beautifulsoup4
• tqdm

Install dependencies:

pip install -r requirements.txt 

(Note: The requirements file seems named requirenments.txt, consider renaming it to requirements.txt)

Usage

python fetch_bible.py --version <VERSION_CODE> [--book <BOOK_NAME>] [--chapters <RANGE>] [--dest <DIR>] [--concurrency <N>]

Arguments:

• --version VERSION_CODE: Required. The Bible version code (e.g., PDT, NTV, RVR1960). Used for the download URL and directory naming.
• --book BOOK_NAME: Optional. The name of the book to download (e.g., "Genesis", "Psalms", "Apocalipsis"). If omitted, the script will download all 66 books of the Bible.
• --chapters RANGE: Optional. Specifies the chapters to download. Can be a single number, a comma-separated list (1,3,5), a range (1-5), or a combination (1-5,8,10). Default is all.
• --dest DIR: Optional. The root directory where the downloaded files will be saved. Defaults to ./data. Files will be organized as <DIR>/<VERSION>/<ORDER_CODE>/<CODE>.<CHAP>.json (e.g., ./data/PDT/01_gen/gen.001.json).
• --concurrency N: Optional. The number of chapters to download simultaneously. Defaults to 10.

Examples:

• Download the entire PDT version:

  python fetch_bible.py --version PDT

• Download only Genesis chapter 1 from NTV version into the downloads directory:

  python fetch_bible.py --version NTV --book Genesis --chapters 1 --dest ./downloads

• Download Psalms chapters 1 to 5 and chapter 23 from RVR1960:

  python fetch_bible.py --version RVR1960 --book Salmos --chapters 1-5,23 

2. Converting JSON to FreeShow Format (convert_bible.py)

This script reads the downloaded JSON chapter files for specified Bible versions and converts them into the FreeShow Bible format (.fsb.json) containing structured Bible data ready for import.

Usage

python convert_bible.py [--versions <VERSION_CODE> [<VERSION_CODE> ...]] [--source <DIR>] [--output <FILE>] <repo_root>

Arguments:

• <repo_root>: Required. The path to the root directory containing the version folders (e.g., ./data). This should be the last argument.
• --versions VERSION_CODE [VERSION_CODE ...]: Optional. If specified, only process these exact version codes (case-insensitive).
• --source DIR: DEPRECATED/INCORRECT? (Seems the script expects repo_root as positional argument, not via --source).
• --outdir DIR: Optional. The output directory for the .fsb.json files. Defaults to ./exports.
• --output FILE: DEPRECATED/INCORRECT? (Seems the script uses --outdir to specify the output directory, not a single file path).

Example:

• Convert only PDT and NTV versions found within the ./data directory:

  python convert_bible.py --versions PDT NTV ./data

• Convert only RVR60 found within ./my_bible_downloads and output to ./generated:

  python convert_bible.py --versions RVR60 --outdir ./generated ./my_bible_downloads

The resulting .fsb.json files will be placed in the specified output directory (defaulting to ./exports), ready for import into FreeShow.