Code

Features/crawler#90

Code

Closed

steffencruz wants to merge 57 commits intopre-stagingmacrocosm-os/prompting:pre-stagingfrom features/crawlermacrocosm-os/prompting:features/crawlerCopy head branch name to clipboard

Commits

Commits on Feb 3, 2024

• Adds redesigned datasets and base Context

  steffencruz

  committed
  3e528e1

  Copy full SHA for 3e528e1

• Adds selector and updates imports

  steffencruz

  committed
  ed7e32e

  Copy full SHA for ed7e32e

• Updates requirements

  steffencruz

  committed
  48f46b6

  Copy full SHA for 48f46b6

• Adds WIP ContextChain which enables conversational crawler

  steffencruz

  committed
  29d2671

  Copy full SHA for 29d2671

• Add todos

  steffencruz

  committed
  9ae63f3

  Copy full SHA for 9ae63f3

Commits on Feb 4, 2024

• Update mathgenerator dependency

  steffencruz

  committed
  9b93d76

  Copy full SHA for 9b93d76

• Merge features/task-expansion into features/crawler for new math dataset and task, and reward updates

  steffencruz

  committed
  1c3cff4

  Copy full SHA for 1c3cff4

• Make wiki.random pseudo-deterministic

  steffencruz

  committed
  46eb82f

  Copy full SHA for 46eb82f

• Make summarization query more specific (particular article section)

  steffencruz

  committed
  8008cf9

  Copy full SHA for 8008cf9

• Refactor math task so it uses proper ABC base methods

  steffencruz

  committed
  9e3c4f4

  Copy full SHA for 9e3c4f4

• Fix missing imports and remove unnecessary lines

  steffencruz

  committed
  a38bcba

  Copy full SHA for a38bcba

• Change requirement formatting to be consistent with setup.py

  steffencruz

  committed
  8893219

  Copy full SHA for 8893219

• prototype math dataset with updated source code

  steffencruz

  committed
  465244b

  Copy full SHA for 465244b

Commits on Feb 5, 2024

• Remove notebook

  steffencruz

  committed
  c04bcdf

  Copy full SHA for c04bcdf

Commits on Feb 7, 2024

• Reformatting and add creator field to Context.stats

  steffencruz

  committed
  5b318d2

  Copy full SHA for 5b318d2

• Implement code

  steffencruz

  committed
  ab75cf2

  Copy full SHA for ab75cf2

• Reformat math dataset external links to be more decriptive and random

  steffencruz

  committed
  a2a20ed

  Copy full SHA for a2a20ed

• Better handling of wiki errors with attempted recovery

  steffencruz

  committed
  9f6e4d6

  Copy full SHA for 9f6e4d6

• Cleanup file, add walker and change some transition rules for improved stability

  steffencruz

  committed
  421ac9f

  Copy full SHA for 421ac9f

Commits on Feb 8, 2024

• Improve external links for more diverse wiki search

  steffencruz

  committed
  4adc871

  Copy full SHA for 4adc871

• rename all_languages to LANGUAGES

  steffencruz

  committed
  c754f57

  Copy full SHA for c754f57

Commits on Feb 9, 2024

• Move task definitions to task module init

  steffencruz

  committed
  b8ea697

  Copy full SHA for b8ea697

• use task aliases

  steffencruz

  committed
  e1affce

  Copy full SHA for e1affce

• force create sections

  steffencruz

  committed
  f30afb8

  Copy full SHA for f30afb8

Commits on Feb 10, 2024

• Improve performance and add tags

  steffencruz

  committed
  073739a

  Copy full SHA for 073739a

• Add missing fields to MockDataset

  steffencruz

  committed
  063288d

  Copy full SHA for 063288d

• Add tags

  steffencruz

  committed
  4ee9636

  Copy full SHA for 4ee9636

• Remove unused function and cleanup returned dict

  steffencruz

  committed
  13b0db6

  Copy full SHA for 13b0db6

• Refactor QuestionAnsweringTask with new context object

  steffencruz

  committed
  c1ddd1f

  Copy full SHA for c1ddd1f

• Refactor SummarizationTask with new context object

  steffencruz

  committed
  350b45b

  Copy full SHA for 350b45b

• Refactor DateQuestionAnsweringTask with new context object

  steffencruz

  committed
  a489def

  Copy full SHA for a489def

• Refactor MathTask with new context object

  steffencruz

  committed
  33482a1

  Copy full SHA for 33482a1

• Refactor DebuggingTask with new context object, and remove unused prompt templates and methods

  steffencruz

  committed
  5fb422b

  Copy full SHA for 5fb422b

• Update __state_dict__ for new context object

  steffencruz

  committed
  e2b3edb

  Copy full SHA for e2b3edb

• Refactor tests

  steffencruz

  committed
  ff8309c

  Copy full SHA for ff8309c

• Remove old dataset file

  steffencruz

  committed
  999e53a

  Copy full SHA for 999e53a

• Fix bug in corrupt args

  steffencruz

  committed
  520bb1a

  Copy full SHA for 520bb1a

• Fix arg name error

  steffencruz

  committed
  8863e65

  Copy full SHA for 8863e65

Commits on Feb 13, 2024

• Add transition probs for markov chain

  steffencruz

  committed
  ee6bc2b

  Copy full SHA for ee6bc2b

• Remove create_task

  steffencruz

  committed
  c62f15b

  Copy full SHA for c62f15b

• Deploy context chain as the basis for conversation

  steffencruz

  committed
  10c84c9

  Copy full SHA for 10c84c9

• Replace Persona with create_persona

  steffencruz

  committed
  5389a38

  Copy full SHA for 5389a38

• Fix attribute error

  steffencruz

  committed
  91a0212

  Copy full SHA for 91a0212

• Add _parse_tasks which ensures that tasks are ordered as expected

  steffencruz

  committed
  9f53b4c

  Copy full SHA for 9f53b4c

• Reorder tasks

  steffencruz

  committed
  8f37542

  Copy full SHA for 8f37542

• Reorder tasks

  steffencruz

  committed
  9d649ff

  Copy full SHA for 9d649ff

• Pass markov parameters to TransitionMatrix

  steffencruz

  committed
  731e99b

  Copy full SHA for 731e99b

Commits on Feb 14, 2024

• Merge main

  steffencruz

  committed
  9569921

  Copy full SHA for 9569921

Commits on Feb 15, 2024

• Sets initial task probs to a uniform distribution

  steffencruz

  committed
  abea63b

  Copy full SHA for abea63b

• Merge features/task-expansion

  steffencruz

  committed
  c37185f

  Copy full SHA for c37185f

Commits on Feb 18, 2024

• Add MaxRetryError exception for controlling the program flow when a dataset cannot be created

  steffencruz

  committed
  06e1d55

  Copy full SHA for 06e1d55

• Throw MaxRetryError instead of ValueError

  steffencruz

  committed
  6d6a616

  Copy full SHA for 6d6a616

• Catch MaxRetryError and continue running

  steffencruz

  committed
  d1a0dac

  Copy full SHA for d1a0dac

Commits on Feb 21, 2024

• Merge with features/context

  steffencruz

  committed
  23a6316

  Copy full SHA for 23a6316

• Merge with remote features/crawler

  steffencruz

  committed
  fdef025

  Copy full SHA for fdef025

Commits on Mar 1, 2024

• Merge with main;

  steffencruz

  committed
  6403689

  Copy full SHA for 6403689

• Merge branch 'pre-staging' into features/crawler

  steffencruz

  authored
  70f5a12

  Copy full SHA for 70f5a12