Code

Architecture refactoring#61

Code

Merged

toadharvard merged 153 commits intoDesbordante:mainDesbordante/desbordante-server:mainfrom raf-nr:clean-architecture-refactorraf-nr/desbordante-server:clean-architecture-refactorCopy head branch name to clipboardOct 7, 2024

+8,645-3,849

Commits

Commits on Sep 12, 2024

• chore(ci): remove the limitation on branches for automatic testing

  raf-nr

  committed
  ae2c676

  Copy full SHA for ae2c676

• chore(domain): replace optional model to new domain module

  raf-nr

  committed
  bbdd4ea

  Copy full SHA for bbdd4ea

• feat(tests): add tests for optional model

  raf-nr

  committed
  20fa0c1

  Copy full SHA for 20fa0c1

• feat(domain): add file entity

  raf-nr

  committed
  f801d15

  Copy full SHA for f801d15

• feat(tests): add tests for file entity

  raf-nr

  committed
  9f7757e

  Copy full SHA for 9f7757e

• chore(domain): replace and restructure task entities to new domain module

  raf-nr

  committed
  464bf2c

  Copy full SHA for 464bf2c

• chore: change imports to absolute ones

  raf-nr

  committed
  3fb52eb

  Copy full SHA for 3fb52eb

Commits on Sep 17, 2024

• chore(domain): add empty user submodule to domain module

  raf-nr

  committed
  2c397d8

  Copy full SHA for 2c397d8

• fix(domain): add handling of incorrect case in optional model

  raf-nr

  committed
  9fbfed1

  Copy full SHA for 9fbfed1

• chore(domain): add code documentation for tasks and file

  raf-nr

  committed
  4e929ea

  Copy full SHA for 4e929ea

• chore(domain): add README files for domain modules

  raf-nr

  committed
  bac652e

  Copy full SHA for bac652e

• chore(use case): init use case module, exception and dto submodules

  raf-nr

  committed
  11319b7

  Copy full SHA for 11319b7

• chore(use case): init file, task and user use case modules

  raf-nr

  committed
  19b2f3f

  Copy full SHA for 19b2f3f

• chore: add pytest mock, pytest asyncio and cfgv to dependencies

  raf-nr

  committed
  9f60d7b

  Copy full SHA for 9f60d7b

• fix: replace dto module to internal

  raf-nr

  committed
  ffd25d1

  Copy full SHA for ffd25d1

• feat(dto): add base schema for dto

  raf-nr

  committed
  a983a54

  Copy full SHA for a983a54

• feat(dto): add dto schemas for file

  raf-nr

  committed
  5cac8bb

  Copy full SHA for 5cac8bb

• feat(dto): add dto schemas for file metadata

  raf-nr

  committed
  f086724

  Copy full SHA for f086724

• feat(dto): add dto schemas for dataset

  raf-nr

  committed
  e0abbe2

  Copy full SHA for e0abbe2

• feat(dto): add dto schemas for task

  raf-nr

  committed
  7dce251

  Copy full SHA for 7dce251

• chore: init repository exceptions file

  raf-nr

  committed
  876314f

  Copy full SHA for 876314f

• feat(dto): add dto schemas for task worker

  raf-nr

  committed
  77f4814

  Copy full SHA for 77f4814

• chore: add readme file for dto module

  raf-nr

  committed
  c48e450

  Copy full SHA for c48e450

• feat: add file and dataset exceptions

  raf-nr

  committed
  095054b

  Copy full SHA for 095054b

• fix: delete old use case exception module

  raf-nr

  committed
  01c264e

  Copy full SHA for 01c264e

Commits on Sep 18, 2024

• feat(use case): add use case for file's content type checking

  raf-nr

  committed
  1aea56a

  Copy full SHA for 1aea56a

• feat(tests): add tests for file's content type checking use case

  raf-nr

  committed
  d35b28f

  Copy full SHA for d35b28f

• feat: add Unit Of Work pattern implementation

  raf-nr

  committed
  adf1394

  Copy full SHA for adf1394

• feat(tests): add tests for unit of work

  raf-nr

  committed
  4dccf1c

  Copy full SHA for 4dccf1c

• feat(use case): add use case for saving datasets

  raf-nr

  committed
  549c905

  Copy full SHA for 549c905

• feat(tests): add tests for save dataset use case

  raf-nr

  committed
  04d67bc

  Copy full SHA for 04d67bc

• feat(use case): add use case for file saving

  raf-nr

  committed
  9bacfc0

  Copy full SHA for 9bacfc0

• feat(tests): add tests for save file use case

  raf-nr

  committed
  5054d11

  Copy full SHA for 5054d11

• feat: add task use cases' exceptions

  raf-nr

  committed
  f6eae29

  Copy full SHA for f6eae29

• feat(use case): add use case for retrieving task

  raf-nr

  committed
  3f6a6cd

  Copy full SHA for 3f6a6cd

• feat(tests): add tests for retrieve task use case

  raf-nr

  committed
  c1a5bb6

  Copy full SHA for c1a5bb6

• chore: add missing imports

  raf-nr

  committed
  933edc1

  Copy full SHA for 933edc1

• feat(use case): add use case for setting task

  raf-nr

  committed
  3aeadd7

  Copy full SHA for 3aeadd7

• feat(tests): add tests for set task use case

  raf-nr

  committed
  0b3ddff

  Copy full SHA for 0b3ddff

• chore: add file for user's use case exceptions

  raf-nr

  committed
  1ac699e

  Copy full SHA for 1ac699e

• chore: add readme file for usecase module

  raf-nr

  committed
  ddf134d

  Copy full SHA for ddf134d

• chore: init infrastructure, repository and worker modules

  raf-nr

  committed
  6973494

  Copy full SHA for 6973494

• chore(infra): init data storage module

  raf-nr

  committed
  ba6974f

  Copy full SHA for ba6974f

• feat(infra): add settings for data storages

  raf-nr

  committed
  6c05e60

  Copy full SHA for 6c05e60

• feat(infra): add context implementation for postgres

  raf-nr

  committed
  68bd15e

  Copy full SHA for 68bd15e

• feat(infra): add base orm model for relational data bases

  raf-nr

  committed
  77cb1ff

  Copy full SHA for 77cb1ff

• feat(infra): add base orm model for relational data bases

  raf-nr

  committed
  e904208

  Copy full SHA for e904208

• feat(infra): add file metadata model for relational data bases

  raf-nr

  committed
  6883f13

  Copy full SHA for 6883f13

• feat(infra): add dataset model for relational data bases

  raf-nr

  committed
  2bdaec4

  Copy full SHA for 2bdaec4

• feat(infra): add task model for relational data bases

  raf-nr

  committed
  174bb42

  Copy full SHA for 174bb42

• chore(infra): add empty module for user relational models

  raf-nr

  committed
  906ad41

  Copy full SHA for 906ad41

• chore: set new directories for test command in the makefile

  raf-nr

  committed
  8192e40

  Copy full SHA for 8192e40

• chore: set new alembic.ini file's path for postgres migrations command in the makefile

  raf-nr

  committed
  fbe79a1

  Copy full SHA for fbe79a1

• feat(infra): add first empty postgres migration

  raf-nr

  committed
  45988c0

  Copy full SHA for 45988c0

• feat(infra): add postgres db migration that creates file and dataset table

  raf-nr

  committed
  becf941

  Copy full SHA for becf941

• feat(infra): add postgres db migration that creates task table

  raf-nr

  committed
  1cbe946

  Copy full SHA for 1cbe946

• feat(repo): add file repository implementation

  raf-nr

  committed
  97f1ca4

  Copy full SHA for 97f1ca4

Commits on Sep 19, 2024

• chore(infra): rename and replace relational storage context

  raf-nr

  committed
  1ad0cd3

  Copy full SHA for 1ad0cd3

• chore(repo): format code

  raf-nr

  committed
  c53091d

  Copy full SHA for c53091d

Commits on Sep 20, 2024

• fix(infra): remove typo in dataset relational model's fields

  raf-nr

  committed
  439e6cc

  Copy full SHA for 439e6cc

• fix(uow): change the way to return a context from uow

  raf-nr

  committed
  67e8f94

  Copy full SHA for 67e8f94

• feat(use case): add file metadata not found exception

  raf-nr

  committed
  c74ca72

  Copy full SHA for c74ca72

• feat(use case): add use case for retrieving datasets

  raf-nr

  committed
  806b6d9

  Copy full SHA for 806b6d9

• feat(tests): add tests for retrieve dataset use case

  raf-nr

  committed
  606b8e4

  Copy full SHA for 606b8e4

• fix(use case): remove unnecessery fields in profiling task worker interface

  raf-nr

  committed
  69cdbc6

  Copy full SHA for 69cdbc6

• chore(use case): make usecase arguments callable only by key-value

  raf-nr

  committed
  307f1ad

  Copy full SHA for 307f1ad

• feat(use case): add use case for updating task info

  raf-nr

  committed
  e35f077

  Copy full SHA for e35f077

• chore(dto): update task update schema

  raf-nr

  committed
  383fdf1

  Copy full SHA for 383fdf1

• feat(tests): add tests for updating task info use case

  raf-nr

  committed
  cf6ac02

  Copy full SHA for cf6ac02

• feat(dto): add dataset and file metadata repositories' exceptions

  raf-nr

  committed
  b2a654e

  Copy full SHA for b2a654e

• feat(dto): add find and response schemas for csv files

  raf-nr

  committed
  cf8ba5b

  Copy full SHA for cf8ba5b

• feat(domain): add a function to get a primitive by its name

  raf-nr

  committed
  efb4913

  Copy full SHA for efb4913

• feat(use case): add use case for task profiling

  raf-nr

  committed
  c2c1701

  Copy full SHA for c2c1701

• feat(tests): add tests for profilie task use case

  raf-nr

  committed
  e010653

  Copy full SHA for e010653

• chore(infra): change name of relational context type

  raf-nr

  committed
  cab295a

  Copy full SHA for cab295a

• feat(infra): add postgres context and context maker

  raf-nr

  committed
  7e52f89

  Copy full SHA for 7e52f89

• feat(repo): add find(read) csv file method to the file repository

  raf-nr

  committed
  27124ea

  Copy full SHA for 27124ea

• feat(repo): add class with crud operations for relational repositories

  raf-nr

  committed
  6cf24b6

  Copy full SHA for 6cf24b6

• feat(repo): add file metadata repository implementation

  raf-nr

  committed
  2f1c506

  Copy full SHA for 2f1c506

• fix(tests): update conftest file, delete alembic tests

  raf-nr

  committed
  efdc4a8

  Copy full SHA for efdc4a8

• feat(infra): add necessary imports for migrations

  raf-nr

  committed
  b963293

  Copy full SHA for b963293

• feat(repo): add dataset repository implementation

  raf-nr

  committed
  73fcab2

  Copy full SHA for 73fcab2

• feat(tests): update conftest file with database preparing fixture

  raf-nr

  committed
  62c021b

  Copy full SHA for 62c021b

• feat(repo): add find with join for dataset repository

  raf-nr

  committed
  4f205d3

  Copy full SHA for 4f205d3

• feat(repo): add task repository implementation

  raf-nr

  committed
  812b523

  Copy full SHA for 812b523

• feat(infra): init background task and celery modules

  raf-nr

  committed
  e69eb79

  Copy full SHA for e69eb79

• feat(infra): add settings for background tasks

  raf-nr

  committed
  11e4773

  Copy full SHA for 11e4773

• feat(infra): add celery config

  raf-nr

  committed
  7e3a337

  Copy full SHA for 7e3a337

• feat(infra): add resource intensive celery task class

  raf-nr

  committed
  d5c290e

  Copy full SHA for d5c290e

• feat(infra): add dependencies for injection in celery tasks

  raf-nr

  committed
  32af375

  Copy full SHA for 32af375

• feat(infra): add data profiling celery task

  raf-nr

  committed
  a73b900

  Copy full SHA for a73b900

• feat(infra): add the main celery worker

  raf-nr

  committed
  5ba0b87

  Copy full SHA for 5ba0b87

• feat(worker): add data profiling worker implementation (for celery)

  raf-nr

  committed
  1fd1fbb

  Copy full SHA for 1fd1fbb

• feat(rest): init rest module and its submodules

  raf-nr

  committed
  cefb554

  Copy full SHA for cefb554

• feat(test): add ping endpoint, common router

  raf-nr

  committed
  15b4bfc

  Copy full SHA for 15b4bfc

• feat(rest): add dependencies for injection in endpoints

  raf-nr

  committed
  a47646f

  Copy full SHA for a47646f

• feat(rest): add dependencies for injection in file/dataset endpoints

  raf-nr

  committed
  38f5963

  Copy full SHA for 38f5963

• feat(rest): add endpoint for upload csv datasets

  raf-nr

  committed
  a917b95

  Copy full SHA for a917b95

• feat(rest): add endpoint for retrieve datasets

  raf-nr

  committed
  d3bd6a4

  Copy full SHA for d3bd6a4

• feat(rest): add dependencies for injection in task endpoints

  raf-nr

  committed
  6b31383

  Copy full SHA for 6b31383

• feat(rest): add endpoint for task setting

  raf-nr

  committed
  809a8d0

  Copy full SHA for 809a8d0

• feat(rest): add endpoint for task retrieving

  raf-nr

  committed
  f0f2210

  Copy full SHA for f0f2210

• feat(rest): add di module for user

  raf-nr

  committed
  65c57a1

  Copy full SHA for 65c57a1

• feat(rest): add main api router

  raf-nr

  committed
  7c120a7

  Copy full SHA for 7c120a7

• feat: add main application (fastapi) object

  raf-nr

  committed
  7807ba9

  Copy full SHA for 7807ba9

• feat: change path to app object and celery worker in makefile

  raf-nr

  committed
  6209e71

  Copy full SHA for 6209e71

• fix(repo): typo in imports

  raf-nr

  committed
  80eb264

  Copy full SHA for 80eb264

• fix(tests): remove typo in fixture name

  raf-nr

  committed
  4f26968

  Copy full SHA for 4f26968

• chore: change name for celery worker in makefile

  raf-nr

  committed
  f19e995

  Copy full SHA for f19e995

Commits on Sep 21, 2024

• fix(infra): make the correct traceback processing

  raf-nr

  committed
  55ad7b6

  Copy full SHA for 55ad7b6

• feat(rest): add use case's exceptions handling

  raf-nr

  committed
  35b8306

  Copy full SHA for 35b8306

• chore(domain): add code documentation for math function

  raf-nr

  committed
  d53540a

  Copy full SHA for d53540a

• chore: add failed file read exception and its handler

  raf-nr

  committed
  bfef666

  Copy full SHA for bfef666

• chore: delete old app module

  raf-nr

  committed
  c5ba4ca

  Copy full SHA for c5ba4ca

• chore: format code

  raf-nr

  committed
  2623cd5

  Copy full SHA for 2623cd5

• chore: change old module path in all makefile commands

  raf-nr

  committed
  82cce96

  Copy full SHA for 82cce96

• fix(tests): remove typo in exception name and expande uow mocks

  raf-nr

  committed
  27c4184

  Copy full SHA for 27c4184

• feat(infra): add flat file storage context and update use cases

  raf-nr

  committed
  0574ed8

  Copy full SHA for 0574ed8

• feat(rest): update di after add new flat context

  raf-nr

  committed
  3032413

  Copy full SHA for 3032413

• fix: typo in file metadata repository name

  raf-nr

  committed
  0f65293

  Copy full SHA for 0f65293

• feat(tests): add tests for file repository

  raf-nr

  committed
  57e0320

  Copy full SHA for 57e0320

• feat(tests): add tests for file metadata repository

  raf-nr

  committed
  abbe5a2

  Copy full SHA for abbe5a2

• feat(tests): add tests for dataset repository

  raf-nr

  committed
  d8bc2ee

  Copy full SHA for d8bc2ee

• feat(tests): add tests for task repository

  raf-nr

  committed
  c0b3c13

  Copy full SHA for c0b3c13

• fix(tests): add converter from UUID to string for file name

  raf-nr

  committed
  315f6bb

  Copy full SHA for 315f6bb

• chore(domain): move task status and task failure reason classes in separate module

  raf-nr

  committed
  facf649

  Copy full SHA for facf649

• fix(dto): remove unnecessery generic in update schemas

  raf-nr

  committed
  23e7c58

  Copy full SHA for 23e7c58

• chore: add and fix documentation for repo and use case exceptions

  raf-nr

  committed
  d6a3e5f

  Copy full SHA for d6a3e5f

• chore(infra): add readme file for data storage module

  raf-nr

  committed
  1ee1d93

  Copy full SHA for 1ee1d93

• chore(infra): correct typing

  raf-nr

  committed
  35e27a9

  Copy full SHA for 35e27a9

• chore: update new directories path in Dockerfile

  raf-nr

  committed
  2115922

  Copy full SHA for 2115922

• chore(infra): add missed imports to postgres env.py file

  raf-nr

  committed
  f4af48a

  Copy full SHA for f4af48a

• chore: fix format errors

  raf-nr

  committed
  eeb12b2

  Copy full SHA for eeb12b2

Commits on Sep 25, 2024

• chore: delete sqlalchemy mixins from project dependencies

  raf-nr

  committed
  d36ab13

  Copy full SHA for d36ab13

Commits on Sep 27, 2024

• fix: type errors

  raf-nr

  committed
  636488c

  Copy full SHA for 636488c

• chore: add command for type checking in makefile and rename old target names

  raf-nr

  committed
  835272c

  Copy full SHA for 835272c

• chore: add type checking to ci

  raf-nr

  committed
  e5e1c21

  Copy full SHA for e5e1c21

Commits on Sep 30, 2024

• chore(infra): add relational/postgres context maker types

  raf-nr

  committed
  cad5d30

  Copy full SHA for cad5d30

• chore(infra): add helper functions for getting postgres context

  raf-nr

  committed
  459d797

  Copy full SHA for 459d797

Commits on Oct 1, 2024

• feat(infra): implement an analogue of a transaction for local storage

  raf-nr

  committed
  79ebcce

  Copy full SHA for 79ebcce

• feat(tests): add tests for new flat context

  raf-nr

  committed
  72910be

  Copy full SHA for 72910be

• feat(infra): add relational add/delete models

  raf-nr

  committed
  eeff5b9

  Copy full SHA for eeff5b9

• chore(tests): divide the test directory into subdirectories for unit and integration testing

  raf-nr

  committed
  af7aeb9

  Copy full SHA for af7aeb9

• feat(infra): implement sync flush method for flat context

  raf-nr

  committed
  9025b96

  Copy full SHA for 9025b96

• feat(infra): add universal context for storages

  raf-nr

  committed
  6550cee

  Copy full SHA for 6550cee

• feat(tests): add tests for universal context

  raf-nr

  committed
  07857a3

  Copy full SHA for 07857a3

• chore(usecase): add missed task usecases imports

  raf-nr

  committed
  d26bec2

  Copy full SHA for d26bec2

Commits on Oct 2, 2024

• feat(usecase): make a single unit of work in each use case and its usage in app

  raf-nr

  committed
  b2ffbe3

  Copy full SHA for b2ffbe3

• feat(repo): add processing for case when value is not found when updating in the database

  raf-nr

  committed
  673611c

  Copy full SHA for 673611c

• feat(tests): add tests that check dependencies between modules

  raf-nr

  committed
  4b1fcfa

  Copy full SHA for 4b1fcfa

• feat(tests): set up the correct system of fixtures with access to storage systems

  raf-nr

  committed
  e787967

  Copy full SHA for e787967

• feat(tests): add integration tests for all api usage scenarios

  raf-nr

  committed
  00d24e8

  Copy full SHA for 00d24e8

• chore: format code, and some documentation and readme files

  raf-nr

  committed
  b19ed84

  Copy full SHA for b19ed84