Skip to content

Commit b27473f

Browse files
authored
instructions typo fix and deps update (#38)
1 parent 8f54bd3 commit b27473f

File tree

3 files changed

+13
-12
lines changed

3 files changed

+13
-12
lines changed

docs/_docs/home.md

+5-5
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ demo_names = wl.utils.load_demo_names_in_split(split_path, split='train')
8888
demo_names = ['saabwsg', 'ygprzve', 'iqaazif'] # 3 random demo from valid
8989

9090
# Load the demonstrations
91-
demos = [wl.Demonstration(name, base_dir=base_dir) for name in names]
91+
demos = [wl.Demonstration(name, base_dir=base_dir) for name in demo_names]
9292

9393
# Select a demo to work with
9494
demo = demos[0]
@@ -183,13 +183,13 @@ from weblinx.processing import load_candidate_elements
183183

184184
# Download the candidates elements generated by the MiniLM-L6-dmr model
185185
snapshot_download(
186-
repo_id="McGill-NLP/WebLINX-full",
187-
repo_type="dataset",
188-
allow_patterns="candidates/*.jsonl",
186+
repo_id="McGill-NLP/WebLINX-full",
187+
repo_type="dataset",
188+
allow_patterns="candidates/*.jsonl",
189189
local_dir="./wl_data/"
190190
)
191191

192-
split = "train" # or valid, test, test_geo, test_vis, test_web, test_cat
192+
split = "train" # or valid, test, test_geo, test_vis, test_web, test_cat
193193
candidates_path = f"./wl_data/candidates/{split}.jsonl"
194194
# Access the candidates
195195
candidates = load_candidate_elements(path=candidates_path)

modeling/README.md

+5-5
Original file line numberDiff line numberDiff line change
@@ -14,9 +14,9 @@ snapshot_download(
1414

1515
# candidates files
1616
snapshot_download(
17-
repo_id="McGill-NLP/WebLINX-full",
18-
repo_type="dataset",
19-
allow_patterns="candidates/*.jsonl",
17+
repo_id="McGill-NLP/WebLINX-full",
18+
repo_type="dataset",
19+
allow_patterns="candidates/*.jsonl",
2020
local_dir="./wl_data/"
2121
)
2222
```
@@ -72,7 +72,7 @@ ln -s /location/of/your/full/data /location/of/project/weblinx/modeling/wl_data
7272
For example, if your data is located at `/mnt/research/scratch/users/jdoe/WebLINX-full` but your cloned `weblinx` repository is at `~/dev/weblinx`, then you'd run:
7373

7474
```bash
75-
ln -s /mnt/research/scratch/users/jdoe/WebLINX-full ~/dev/weblinx/modeling/wl_data
75+
ln -s /mnt/research/scratch/users/jdoe/WebLINX-full/* ~/dev/weblinx/modeling/wl_data
7676
```
7777

7878
Which corresponds to the `data.base_dir` specified in `config.yml`, which is `"${project_dir}/wl_data/demonstrations/"`.
@@ -122,7 +122,7 @@ The `scores.jsonl` and `results.json` files will be saved at the `cfg.eval.resul
122122
# Change the following paths to match your setup
123123
orig_dir="/path/to/weblinx/modeling/results/dmr/sentence-transformers/all-MiniLM-L6-v2"
124124

125-
# This is the directory where the candidates are stored
125+
# This is the directory where the candidates are stored
126126
new_dir="/path/to/wl_data/candidates"
127127

128128
# You need to move the train split if you plan to use it for training the action model

modeling/requirements.txt

+3-2
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
transformers==4.35.0 # Future version may break the code, upgrade with caution
1+
transformers==4.42.3 # Future version may break the code, upgrade with caution. Previous stable version was 4.35.0
22
lxml
33
numpy
44
datasets
@@ -19,4 +19,5 @@ coloredlogs
1919
sacrebleu
2020
bert-score
2121
packaging
22-
ninja
22+
ninja
23+
huggingface-hub>=0.23.4, <0.24

0 commit comments

Comments
 (0)