feat: Code and equation model for PDF and code blocks in markdown #752
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Merge ProtectionsYour pull request matches the following merge protections and will not be merged until they are valid. 🟢 Enforce conventional commitWonderful, this rule succeeded.Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/
🟢 Require two reviewer for test updatesWonderful, this rule succeeded.When test data is updated, we require two reviewers
|
cau-git
changed the title
Matteo-Omenetti
force-pushed
the
mao1/code_equation_model
branch
from
156d38b to
aa221c7
Compare
Signed-off-by: Matteo Omenetti <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
Signed-off-by: Christoph Auer <[email protected]>
Matteo-Omenetti
force-pushed
the
mao1/code_equation_model
branch
from
fe04026 to
bfccc6e
Compare
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
dolfim-ibm
reviewed
Jan 24, 2025
dolfim-ibm
reviewed
Jan 24, 2025
Signed-off-by: Matteo Omenetti <[email protected]>
Co-authored-by: Michele Dolfi <[email protected]> Signed-off-by: Matteo <[email protected]>
Signed-off-by: Matteo Omenetti <[email protected]>
…ocling into mao1/code_equation_model
Signed-off-by: Michele Dolfi <[email protected]>
Signed-off-by: Michele Dolfi <[email protected]>
dolfim-ibm
changed the title
Signed-off-by: Michele Dolfi <[email protected]>
vancura
pushed a commit
to vancura/docling
that referenced
this pull request
Feb 6, 2025
…4SD#752) * propagated changes for new CodeItem class Signed-off-by: Matteo Omenetti <[email protected]> * Rebased branch on latest main. changes for CodeItem Signed-off-by: Matteo Omenetti <[email protected]> * removed unused files Signed-off-by: Matteo Omenetti <[email protected]> * chore: update lockfile Signed-off-by: Christoph Auer <[email protected]> * pin latest docling-core Signed-off-by: Michele Dolfi <[email protected]> * update docling-core pinning Signed-off-by: Michele Dolfi <[email protected]> * pin docling-core Signed-off-by: Michele Dolfi <[email protected]> * use new add_code in backends and update typing in MD backend Signed-off-by: Michele Dolfi <[email protected]> * added if statement for backend Signed-off-by: Matteo Omenetti <[email protected]> * removed unused import Signed-off-by: Matteo Omenetti <[email protected]> * removed print statements Signed-off-by: Matteo Omenetti <[email protected]> * gt for new pdf Signed-off-by: Matteo Omenetti <[email protected]> * Update docling/pipeline/standard_pdf_pipeline.py Co-authored-by: Michele Dolfi <[email protected]> Signed-off-by: Matteo <[email protected]> * fixed doc comment of __call__ function of code_formula_model Signed-off-by: Matteo Omenetti <[email protected]> * fix artifacts_path type Signed-off-by: Michele Dolfi <[email protected]> * move imports Signed-off-by: Michele Dolfi <[email protected]> * move expansion_factor to base class Signed-off-by: Michele Dolfi <[email protected]> --------- Signed-off-by: Matteo Omenetti <[email protected]> Signed-off-by: Christoph Auer <[email protected]> Signed-off-by: Michele Dolfi <[email protected]> Signed-off-by: Matteo <[email protected]> Co-authored-by: Christoph Auer <[email protected]> Co-authored-by: Michele Dolfi <[email protected]> Co-authored-by: Michele Dolfi <[email protected]> Signed-off-by: Václav Vančura <[email protected]>
|
Thanks for your awesome work! Could you please provide an example/detailed documentation of how to use this feature? |
|
Hello @ShayanTalaei from docling.datamodel.pipeline_options import PdfPipelineOptions
pipeline_options = PdfPipelineOptions()
pipeline_options.generate_page_images = True
pipeline_options.do_code_enrichment = True
pipeline_options.do_formula_enrichment = True |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
add_code()method in the markdown backend (with typing fixes)