Skip to content
This repository has been archived by the owner on Oct 19, 2024. It is now read-only.

[WIP] [FEATURE] Improve layer construction for inference #800

Open
wants to merge 43 commits into
base: main
Choose a base branch
from
Open

[WIP] [FEATURE] Improve layer construction for inference #800

wants to merge 43 commits into from

Commits on Dec 2, 2022

  1. add test cases on inference layer construction

    @zhuohan123
    zhuohan123 committed Dec 2, 2022
    Configuration menu
    Copy the full SHA
    44a4828 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into inference-layer-construction

    @zhuohan123
    zhuohan123 committed Dec 2, 2022
    Configuration menu
    Copy the full SHA
    2376277 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2022

  1. fix bugs

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    e5ddd93 View commit details
    Browse the repository at this point in the history

  2. fix bugs

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    1893ab1 View commit details
    Browse the repository at this point in the history

  3. fix

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    e3e90b8 View commit details
    Browse the repository at this point in the history

  4. fix

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    f20fd9e View commit details
    Browse the repository at this point in the history

  5. test search

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    4f6f1a4 View commit details
    Browse the repository at this point in the history

  6. fix

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    a7f5e2d View commit details
    Browse the repository at this point in the history

  7. add 1d inference stage construction

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    413bb34 View commit details
    Browse the repository at this point in the history

  8. fix

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    7fa3cfc View commit details
    Browse the repository at this point in the history

  9. fix

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    bf6c932 View commit details
    Browse the repository at this point in the history

  10. add bert tests

    @zhuohan123
    zhuohan123 committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    bf8cf0c View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2022

  1. fix

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    6c23c7c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'inference-1d-stage-construction' into inference-layer-c… 

    …onstruction
    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    9615712 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into inference-layer-construction

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    2da2103 View commit details
    Browse the repository at this point in the history

  4. test 1d stage construction

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    8d41a5f View commit details
    Browse the repository at this point in the history

  5. add layer construction solution logging

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    e7b67db View commit details
    Browse the repository at this point in the history

  6. add some searched results

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    27af75b View commit details
    Browse the repository at this point in the history

  7. test new layer construction

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    8efe119 View commit details
    Browse the repository at this point in the history

  8. fix indexing error

    @zhuohan123
    zhuohan123 committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    7bc7583 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2022

  1. add squared cost

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    a6cc06e View commit details
    Browse the repository at this point in the history

  2. fix bug

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    006c781 View commit details
    Browse the repository at this point in the history

  3. do not use sum, only use squared sum

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    20c3ddb View commit details
    Browse the repository at this point in the history

  4. add search suite

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    04177f8 View commit details
    Browse the repository at this point in the history

  5. add metadata

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    eab6cbd View commit details
    Browse the repository at this point in the history

  6. print python list

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    759d04d View commit details
    Browse the repository at this point in the history

  7. fix

    @zhuohan123
    zhuohan123 committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    de4a365 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2022

  1. fix head ip address

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    6a589a6 View commit details
    Browse the repository at this point in the history

  2. fix available memory bug

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    00c8114 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix-head-ip' into inference-layer-construction

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    acf744a View commit details
    Browse the repository at this point in the history

  4. fix more available memory

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    c1211cc View commit details
    Browse the repository at this point in the history

  5. Merge branch 'fix-head-ip' into inference-layer-construction

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    239e611 View commit details
    Browse the repository at this point in the history

  6. use old layer construction and generate moe search config

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    4e4ca90 View commit details
    Browse the repository at this point in the history

  7. add moe search profile

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    ce7e4e7 View commit details
    Browse the repository at this point in the history

  8. fix

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    ff2ddbf View commit details
    Browse the repository at this point in the history

  9. fix

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    e9bbb58 View commit details
    Browse the repository at this point in the history

  10. fix

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    b8f9fd3 View commit details
    Browse the repository at this point in the history

  11. fix

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    672e17b View commit details
    Browse the repository at this point in the history

  12. name change

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    ddcabeb View commit details
    Browse the repository at this point in the history

  13. Merge branch 'main' into inference-layer-construction

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    bd81a66 View commit details
    Browse the repository at this point in the history

  14. fix tf version

    @zhuohan123
    zhuohan123 committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    944d7c5 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2022

  1. fix

    @zhuohan123
    zhuohan123 committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    0c89467 View commit details
    Browse the repository at this point in the history

  2. fix tf and benchmarking longer sequences

    @zhuohan123
    zhuohan123 committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    c4c9b69 View commit details
    Browse the repository at this point in the history