Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
LeonEricsson committed Oct 23, 2024
1 parent 1d45111 commit cbe1f18
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions blog/2024-09-19-physicsoflm.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,9 +23,9 @@ The study is in three parts: Part 1 - Structures, Part 2 - Reasoning, and Part 3


## Part 2
How do Language Models reason? In this fascinating study, researchers set out to uncover the hidden reasoning processes of language models when solving grade-school math problems. Their goal was to understand the fundamental mental processes these models develop and why they sometimes stumble on seemingly simple problems.
How do Language Models reason? Well, people would argue that they don't, but that discussion is of little interest to me, instead, let's assume they can reason and try to uncover how they do so. The authors set out to uncover the hidden reasoning processes of language models when solving grade-school math problems. Their goal was to understand the fundamental mental processes these models develop and why they sometimes stumble on seemingly simple problems.

To investigate this, the researchers created iGSM - an infinite, synthetic dataset similar to GSM8k. This dataset captures various types of dependencies:
To investigate this, the researchers create iGSM - an infinite, synthetic dataset similar to GSM8k. This dataset captures various types of dependencies:

1. Direct dependency (e.g., A = 5 * (X + Y))
2. Instance dependency (e.g., X classrooms each has Y messenger bags)
Expand Down
2 changes: 1 addition & 1 deletion pages/blog/[id].js
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ export default function Post({ postData }) {
<>{formatDate(postData.date)}.</>
)}
</p>
<div className={`entry text-lg mb-4 ${raleway.className}`}>
<div className={`entry text-base mb-4 ${raleway.className}`}>
<Markdown
remarkPlugins={[remarkGfm, remarkMath]}
rehypePlugins={[rehypeKatex, rehypeRaw]}
Expand Down

0 comments on commit cbe1f18

Please sign in to comment.