Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Table model data deletion #13878

Open
wants to merge 65 commits into
base: master
Choose a base branch
from
Open

Table model data deletion #13878

wants to merge 65 commits into from

Commits on Oct 12, 2024

  1. temp save

    @jt2594838
    jt2594838 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    7dc39f1 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. temp save

    @jt2594838
    jt2594838 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    469f3b6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/LoadTsFileAnalyzer.java
    @jt2594838
    jt2594838 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    f115dc6 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Change modification format

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    480b4b1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	pom.xml
    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    6104265 View commit details
    Browse the repository at this point in the history

  3. update tsfile version

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    45e33a8 View commit details
    Browse the repository at this point in the history

  4. fix deviceId match

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    87baed0 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'table_data_deletion' of github.com:apache/iotdb into ta… 

    …ble_data_deletion
    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    2ec1aa4 View commit details
    Browse the repository at this point in the history

  6. fix identitySinOperatorTest

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    9bb80e3 View commit details
    Browse the repository at this point in the history

  7. refactor interface hierachy

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1dacc0b View commit details
    Browse the repository at this point in the history

  8. refactor package structure

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    acb1a47 View commit details
    Browse the repository at this point in the history

  9. spotless

    @jt2594838
    jt2594838 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    088009b View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. support table deletion

    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    05ba9c8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'table_data_deletion' of github.com:apache/iotdb into ta… 

    …ble_data_deletion

# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/modification/IDPredicate.java
    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    ba59a3f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/LoadTsFileManager.java
    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    2ffd6b4 View commit details
    Browse the repository at this point in the history

  4. fix test

    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    cb83826 View commit details
    Browse the repository at this point in the history

  5. remove v1 mod file

    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    2dc417f View commit details
    Browse the repository at this point in the history

  6. fix read empty mod

    @jt2594838
    jt2594838 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1a234ba View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. add table deletion IT

    @jt2594838
    jt2594838 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    ffc3eba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/compaction/execute/task/InsertionCrossSpaceCompactionTask.java
    @jt2594838
    jt2594838 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    655c84f View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Fix nullability check in buildTsBlock().

    @jt2594838
    jt2594838 committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    ba01a6f View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. fix partialPath type in TreeDeletionEntry

    @jt2594838
    jt2594838 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    bec444a View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. add predicate ut

    @jt2594838
    jt2594838 committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    d64b0a0 View commit details
    Browse the repository at this point in the history

  2. allow multiple mods in a plan node

    @jt2594838
    jt2594838 committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    0dd0c71 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/compaction/execute/utils/CompactionUtils.java
    @jt2594838
    jt2594838 committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    2798a66 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. implment deleteDataForDropTable & fix IT

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    bcf8ccb View commit details
    Browse the repository at this point in the history

  2. fix log level

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    120acb3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/schemaengine/schemaregion/mtree/impl/mem/MTreeBelowSGMemoryImpl.java
    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    d0bfa97 View commit details
    Browse the repository at this point in the history

  4. ignore one test

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    7d5c3a6 View commit details
    Browse the repository at this point in the history

  5. Added table IT (#13978) 

    * Update IoTDBTableIT.java

* Update DataNodeInternalRPCServiceImpl.java
    @Caideyipi
    Caideyipi authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    9b511dc View commit details
    Browse the repository at this point in the history

  6. fix RelationalDeleteDataPlan serialization

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    4319dd7 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'table_data_deletion' of github.com:apache/iotdb into ta… 

    …ble_data_deletion
    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    e42f159 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/resource/tsfile/PipeTsFileResourceManager.java
    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    80197cd View commit details
    Browse the repository at this point in the history

  9. spotless

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    f8b1bd7 View commit details
    Browse the repository at this point in the history

  10. add license

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    5c2230c View commit details
    Browse the repository at this point in the history

  11. Support more compicated deletion predicate

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    2e1f6b1 View commit details
    Browse the repository at this point in the history

  12. fix tests

    @jt2594838
    jt2594838 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    7d660b2 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. update tsfile version & update tests

    @jt2594838
    jt2594838 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    64d6d39 View commit details
    Browse the repository at this point in the history

  2. fix modEntry merge

    @jt2594838
    jt2594838 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3f4e130 View commit details
    Browse the repository at this point in the history

  3. parallel file deletion & fix ut

    @jt2594838
    jt2594838 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    592e595 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. add performance test 

    remove redundant force
optimize the procdedure of writing modfile
    @jt2594838
    jt2594838 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    c511b33 View commit details
    Browse the repository at this point in the history

  2. all shared mod file framework

    @jt2594838
    jt2594838 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    2a86245 View commit details
    Browse the repository at this point in the history

  3. fix TsFileResourceSerialization

    @jt2594838
    jt2594838 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    67359fa View commit details
    Browse the repository at this point in the history

  4. add mod file manager

    @jt2594838
    jt2594838 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    d97bc8b View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. fix TsFileResource deserialization

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    f592321 View commit details
    Browse the repository at this point in the history

  2. fix exception handle

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    6ae9faf View commit details
    Browse the repository at this point in the history

  3. spotless

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    946b536 View commit details
    Browse the repository at this point in the history

  4. fulfill deletion framework

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    9ebc4b7 View commit details
    Browse the repository at this point in the history

  5. ignore perf test

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    884ec96 View commit details
    Browse the repository at this point in the history

  6. use buffered stream to read mods

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    00a44b5 View commit details
    Browse the repository at this point in the history

  7. fix ut

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    09ba21b View commit details
    Browse the repository at this point in the history

  8. spotless

    @jt2594838
    jt2594838 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    002d385 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Merge branch 'master' into table_data_deletion

    @jt2594838
    jt2594838 authored Nov 11, 2024
    Configuration menu
    Copy the full SHA
    5faf169 View commit details
    Browse the repository at this point in the history

  2. add mod file exists marker and log condition

    @jt2594838
    jt2594838 committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    aaeb322 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. fix tests

    @jt2594838
    jt2594838 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    4645ddc View commit details
    Browse the repository at this point in the history

  2. fix test

    @jt2594838
    jt2594838 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    6f185de View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Drop column adaptation (#14073) 

    * drop column

* Update IoTDBTableIT.java

* Update IoTDBTableIT.java
    @Caideyipi
    Caideyipi authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    41e821c View commit details
    Browse the repository at this point in the history

  2. adaptation (#14077)

    @Caideyipi
    Caideyipi authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a87f0e7 View commit details
    Browse the repository at this point in the history

  3. fix comments

    @jt2594838
    jt2594838 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    17f0a7f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'table_data_deletion' of github.com:apache/iotdb into ta… 

    …ble_data_deletion
    @jt2594838
    jt2594838 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d0e6e34 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into table_data_deletion 

    # Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/memtable/TsFileProcessor.java
    @jt2594838
    jt2594838 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1fe88ff View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Fixed the adaptation of delete device (#14081) 

    * adaptation

* Fix

* Update DeleteDevice.java

* Update AnalyzeUtils.java

* Update IoTDBDeviceIT.java
    @Caideyipi
    Caideyipi authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    67c986b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into table_data_deletion

    @jt2594838
    jt2594838 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    a31ff27 View commit details
    Browse the repository at this point in the history

  3. update maxTime in TVList after deletion

    @jt2594838
    jt2594838 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    fcf3f8b View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. fix comment

    @jt2594838
    jt2594838 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    1a54935 View commit details
    Browse the repository at this point in the history