Code

Merge music branch to develop.#56

Code

Merged

ikiss-fit merged 82 commits intodevelopDCGM/pero-ocr:developfrom musicDCGM/pero-ocr:musicCopy head branch name to clipboardNov 14, 2024

+2,377-398

Commits

Commits on Sep 1, 2023

• Add scripts for exporting music from PageLayout to MIDI + MusicXML files.

  vlachvojta

  committed
  fc73bc9

  Copy full SHA for fc73bc9

Commits on Sep 7, 2023

• Add translator dictionary, defining translation from internal shortened labels (model output) to more verbose format usable by export_music.py.

  vlachvojta

  committed
  bda025a

  Copy full SHA for bda025a

Commits on Sep 13, 2023

• Add base for LayoutEngineYolo using ultralytics YOLO. With conversion to PageLayout.

  vlachvojta

  committed
  fe9aceb

  Copy full SHA for fe9aceb

• Junk-code cleanup and docu.

  vlachvojta

  committed
  2da0f24

  Copy full SHA for 2da0f24

• Prepare attributes for music-text distinction. WITHOUT exports to PageXML or ALTO.

  vlachvojta

  committed
  2f661d2

  Copy full SHA for 2f661d2

Commits on Sep 14, 2023

• Add support for region.music_region. WITHOUT exports to PageXML or ALTO.

  vlachvojta

  committed
  5373283

  Copy full SHA for 5373283

• Add category attribute to region. WITH saving to pageXML custom tag + loading.

  vlachvojta

  committed
  1b9b676

  Copy full SHA for 1b9b676

• Add category attribute to TextLine. WITH saving to pageXML custom tag + loading.

  vlachvojta

  committed
  7cc5293

  Copy full SHA for 7cc5293

• Little refactoring.

  vlachvojta

  committed
  fae66ce

  Copy full SHA for fae66ce

• Add exporting music directly in parse_folder.py using config.ini to define settings and page_parser.py to create music exporter object of music/export_music/ExportMusicPage.

  vlachvojta

  committed
  b02ebb2

  Copy full SHA for b02ebb2

Commits on Sep 18, 2023

• Fix minor issue with non-existing function get_las_region_id

  vlachvojta

  committed
  c07ba6a

  Copy full SHA for c07ba6a

• Add sorting music regions "in reading order" using y_min of bounding box around polygon.

  vlachvojta

  committed
  0afb958

  Copy full SHA for 0afb958

Commits on Oct 3, 2023

• Remove RegionCategory and LineCategory enums hard-coded in layout.py. Get names only from Yolo result.names.

  vlachvojta

  committed
  9371467

  Copy full SHA for 9371467

• Update MusicExporter to export music only from certain categories of lines.

  vlachvojta

  committed
  b733c74

  Copy full SHA for b733c74

Commits on Oct 25, 2023

• Remove music exporter option from parse_folder.py and make export_music.py a stand-alone script.

  vlachvojta

  committed
  b40e479

  Copy full SHA for b40e479

Commits on Oct 27, 2023

• Add option to have more LineCroppers and ORC engines. Set every other text Layout engine to work only with 'text' lines.

  vlachvojta

  committed
  7b93d16

  Copy full SHA for 7b93d16

• Disable throwing error if no crop for line. Continue and ignore line.

  vlachvojta

  committed
  50418dd

  Copy full SHA for 50418dd

Commits on Nov 3, 2023

• Add PageLayout splitting enabling running multiple layout parsers each with its own setting and set of categories to work with.

  vlachvojta

  committed
  8853046

  Copy full SHA for 8853046

• Remove unused functions.

  vlachvojta

  committed
  5ce86d1

  Copy full SHA for 5ce86d1

• Merge branch 'develop' into music

  Show description for 16e8ce3
  vlachvojta

  committed
  16e8ce3

  Copy full SHA for 16e8ce3

Commits on Dec 1, 2023

• Add simple script to check if page layouts in two folders have same structure.

  vlachvojta

  committed
  3e2fcb8

  Copy full SHA for 3e2fcb8

• Merge remote-tracking branch 'origin/develop' into music

  vlachvojta

  committed
  a49409c

  Copy full SHA for a49409c

• Disable double logging (stdout + stderr)

  vlachvojta

  committed
  94bcae8

  Copy full SHA for 94bcae8

• Refactor page xml export + import.

  vlachvojta

  committed
  d688bc0

  Copy full SHA for d688bc0

• Refactor alto xml export.

  vlachvojta

  committed
  65eacb5

  Copy full SHA for 65eacb5

Commits on Dec 7, 2023

• Merge remote-tracking branch 'origin/develop' into music

  vlachvojta

  committed
  bb88217

  Copy full SHA for bb88217

Commits on Dec 14, 2023

• Minor updates

  ikiss-fit

  committed
  3354a5b

  Copy full SHA for 3354a5b

• Unify most of method names: page_xml to pagexml and alto_xml to altoxml.

  vlachvojta

  committed
  59dd330

  Copy full SHA for 59dd330

• Unify most of the method names: page_xml to pagexml and alto_xml to altoxml. part 2.

  vlachvojta

  committed
  3c3322e

  Copy full SHA for 3c3322e

• New config section parsing and other changes after code review.

  Show description for 27a82eb
  vlachvojta

  committed
  27a82eb

  Copy full SHA for 27a82eb

Commits on Dec 22, 2023

• Add image_size to Yolo engine. Add config_get_list to get list of categories instead of json string.

  Show description for ae516f4
  vlachvojta

  committed
  ae516f4

  Copy full SHA for ae516f4

• Store box confidence (in LayoutExtractorYOLO) to RegionLayout and export to page_xml region custom.

  vlachvojta

  committed
  e5dd2b8

  Copy full SHA for e5dd2b8

• Add line ID to ALTO export + import.

  vlachvojta

  committed
  529234e

  Copy full SHA for 529234e

• Delete unwanted script.

  vlachvojta

  committed
  036daf3

  Copy full SHA for 036daf3

• Add translating short music output to original encoding.

  Show description for 697990c
  vlachvojta

  committed
  697990c

  Copy full SHA for 697990c

Commits on Dec 29, 2023

• Enable loading model to cpu.

  vlachvojta

  committed
  893baca

  Copy full SHA for 893baca

• Add CATEGORIES option to sorters and delete therefore unused function sort_regions_in_reading_order

  vlachvojta

  committed
  e2a26de

  Copy full SHA for e2a26de

Commits on Jan 4, 2024

• Alto_export: export music transcription as one string in each TextLine

  vlachvojta

  committed
  d59884a

  Copy full SHA for d59884a

Commits on Jan 15, 2024

• Tiny improvements.

  Show description for 0a1a0c0
  vlachvojta

  committed
  0a1a0c0

  Copy full SHA for 0a1a0c0

Commits on Jan 16, 2024

• Delete unused function from layout, music integration.

  Show description for faf0496
  vlachvojta

  committed
  faf0496

  Copy full SHA for faf0496

Commits on Jan 18, 2024

• Change simple print warnings to logger.warning.

  vlachvojta

  committed
  dd4bbc8

  Copy full SHA for dd4bbc8

• Change config categories, line_categories, add decoder filter.

  Show description for 6fc82e4
  vlachvojta

  committed
  6fc82e4

  Copy full SHA for 6fc82e4

• Rename MusicTranslator for to more general OutputTranslator and everything around it.

  Show description for 53ee27a
  vlachvojta

  committed
  53ee27a

  Copy full SHA for 53ee27a

Commits on Jan 22, 2024

• Add option for rendering region categories for non-text regions.

  Show description for 68e7892
  vlachvojta

  committed
  68e7892

  Copy full SHA for 68e7892

• Tiny refactor before moving.

  vlachvojta

  committed
  8ac485e

  Copy full SHA for 8ac485e

• Add minimalistic CLI for MusicPageExporter to user_scripts/export_music.py.

  vlachvojta

  committed
  7032389

  Copy full SHA for 7032389

Commits on Jan 23, 2024

• Normalize category characters in image rendering.

  vlachvojta

  committed
  ef5f36f

  Copy full SHA for ef5f36f

• Add confidence estimation to PageOCR directly after detection. Update TextLine if new confidence is higher.

  Show description for 8c738ee
  vlachvojta

  committed
  8c738ee

  Copy full SHA for 8c738ee

Commits on Jan 26, 2024

• Add PageOCR.get_line_confidence solving problem of wrong confidence estimation.

  Show description for 949829a
  vlachvojta

  committed
  949829a

  Copy full SHA for 949829a

• Unify logging style.

  vlachvojta

  committed
  0b6e933

  Copy full SHA for 0b6e933

• Update readme, remove translator.Semantic_to_SSemantic.json because it was moved to ocr/omr.json (OCR engine config jon).

  vlachvojta

  committed
  092b04f

  Copy full SHA for 092b04f

• Improve translation of symbols in output_translator.py. Return original symbol if not found in dictionary.

  vlachvojta

  committed
  cc47eef

  Copy full SHA for cc47eef

Commits on Jan 31, 2024

• Add atomic option to OutputTranslator + output substitution toggles to PageOCR config section.

  Show description for c7d90a1
  vlachvojta

  committed
  c7d90a1

  Copy full SHA for c7d90a1

Commits on May 29, 2024

• Merge branch 'develop' into music.

  vlachvojta

  committed
  d9430bc

  Copy full SHA for d9430bc

Commits on May 30, 2024

• Fix provides_ctc_logits to look to all ocrs instead of ocr

  vlachvojta

  committed
  2f84712

  Copy full SHA for 2f84712

• Change SUBSTITUTE_OUTPUT_ATOMIC to work on a page level, not individual lines.

  vlachvojta

  committed
  eddf0e3

  Copy full SHA for eddf0e3

• Add config parameter UPDATE_TRANSCRIPTION_BY_CONFIDENCE

  Show description for 70a7e35
  vlachvojta

  committed
  70a7e35

  Copy full SHA for 70a7e35

Commits on Jun 17, 2024

• Add ALTO baseline (export + import) in two options (float or points)

  Show description for 9dcd33f
  vlachvojta

  committed
  9dcd33f

  Copy full SHA for 9dcd33f

Commits on Jun 19, 2024

• Add ALTO versions (options how to export baseline) + both baseline import options.

  Show description for 1a46c00
  vlachvojta

  committed
  1a46c00

  Copy full SHA for 1a46c00

• Save polygon points only as positive numbers. (XSD validation issue)

  vlachvojta

  committed
  2141002

  Copy full SHA for 2141002

• Remove prints.

  vlachvojta

  committed
  34c6584

  Copy full SHA for 34c6584

• Allow run when at least one ORC engine provide_ctc_logits.

  vlachvojta

  committed
  82b3e70

  Copy full SHA for 82b3e70

• Fix README.md example + delete false info about setup.py.

  vlachvojta

  committed
  2aed4bc

  Copy full SHA for 2aed4bc

Commits on Jun 20, 2024

• Update README.md - spelling correction.

  vlachvojta

  committed
  4efdbab

  Copy full SHA for 4efdbab

• Add typing Optional to allow lower versions of Python (tested on Python3.9)

  vlachvojta

  committed
  134f51a

  Copy full SHA for 134f51a

• Add libraries needed to install in docker installation.

  vlachvojta

  committed
  25f555c

  Copy full SHA for 25f555c

• Update texts for better UX.

  vlachvojta

  committed
  26b0c1a

  Copy full SHA for 26b0c1a

Commits on Jun 25, 2024

• Make default version of ALTO to the older one.

  vlachvojta

  committed
  3ce8bbc

  Copy full SHA for 3ce8bbc

• Add typing List and Tuple to allow lower versions of Python (tested on Python3.9)

  vlachvojta

  committed
  3ec7902

  Copy full SHA for 3ec7902

Commits on Jun 27, 2024

• Fix page_xml "custom" field export to export category only if not None.

  vlachvojta

  committed
  520e3ae

  Copy full SHA for 520e3ae

• Set category filter fallback to [] for backward compatibility.

  Show description for 9b414a0
  vlachvojta

  committed
  9b414a0

  Copy full SHA for 9b414a0

• Library versions fixes.

  Show description for a110f0e
  vlachvojta

  committed
  a110f0e

  Copy full SHA for a110f0e

Commits on Jul 11, 2024

• Add libraries back to pyproject.toml, so new machines install it right away.

  vlachvojta

  committed
  f5a7a51

  Copy full SHA for f5a7a51

Commits on Aug 5, 2024

• Fix bugs according to Pull request comment.

  Show description for cc9b0ae
  vlachvojta

  committed
  cc9b0ae

  Copy full SHA for cc9b0ae

• Merge remote-tracking branch 'origin/develop' into music

  vlachvojta

  committed
  62af812

  Copy full SHA for 62af812

• Add regions to splitting by category. If region.category set, move whole region to positive or negative (ignore categories of lines inside the region)

  vlachvojta

  committed
  b60196f

  Copy full SHA for b60196f

Commits on Aug 6, 2024

• Add better None check.

  vlachvojta

  committed
  4d2ddaa

  Copy full SHA for 4d2ddaa

Commits on Aug 27, 2024

• Disable exporting midi lines if no notes on the line.

  Show description for 7c4251e
  vlachvojta

  committed
  7c4251e

  Copy full SHA for 7c4251e

Commits on Sep 24, 2024

• Merge branch 'develop' into music

  vlachvojta

  committed
  d9c64cd

  Copy full SHA for d9c64cd

Commits on Oct 16, 2024

• Simplify splitting page layouts to allow backwards (only look at region category, None = 'text')

  vlachvojta

  committed
  fa1a897

  Copy full SHA for fa1a897

Commits on Oct 25, 2024

• Add IndexError to catch expression when calculating transcription confidence -- in case when there are no logits (i.e. logits.shape[0] == 0) the confidence cannot be calculated.

  ikiss-fit

  committed
  f5f2f42

  Copy full SHA for f5f2f42

Commits on Nov 5, 2024

• Update layout.py

  michal-hradis

  authored
  747e491

  Copy full SHA for 747e491