Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ Integrate lamindb with git #1493

Merged
merged 26 commits into from
Mar 13, 2024
Merged

✨ Integrate lamindb with git #1493

merged 26 commits into from
Mar 13, 2024

Conversation

falexwolf
Copy link
Member

@falexwolf falexwolf commented Mar 12, 2024

WP: https://www.notion.so/laminlabs/Integrate-lamindb-with-git-e328461d4f34413bbb2b2aecda3ddb89

Upon setting sync_git_repo, ln.track() will sync the transform references to a github repo:

import lamindb as ln

ln.settings.sync_git_repo = "https://github.com/laminlabs/laminlabs/arrayloader-benchmarks"
ln.track()

Essentially, you'll get:

assert transform.reference == "https://github.com/laminlabs/arrayloader-benchmarks/blob/8b9a73463bbde7c2923fc8f4525003d7d8106738/benchmark_merlin_mapped_census_epochs.py"

if the script that you run is at https://github.com/laminlabs/arrayloader-benchmarks/blob/8b9a73463bbde7c2923fc8f4525003d7d8106738/benchmark_merlin_mapped_census_epochs.py.

It works by leveraging the git blob and commit hash.

@falexwolf falexwolf changed the title Syncgit ✨ Sync scripts in git with LaminDB transforms Mar 12, 2024
@falexwolf falexwolf changed the title ✨ Sync scripts in git with LaminDB transforms ✨ Map LaminDB transforms onto git commit & blob hashes for Python scripts Mar 12, 2024
@falexwolf falexwolf changed the title ✨ Map LaminDB transforms onto git commit & blob hashes for Python scripts ✨ Map transforms onto git commit & blob hashes for Python scripts Mar 12, 2024
@falexwolf falexwolf changed the title ✨ Map transforms onto git commit & blob hashes for Python scripts ✨ Map transforms onto git hashes for Python scripts Mar 12, 2024
@falexwolf falexwolf changed the title ✨ Map transforms onto git hashes for Python scripts ✨ Integrate git with lamindb Mar 13, 2024
Copy link

codecov bot commented Mar 13, 2024

Codecov Report

Attention: Patch coverage is 93.54839% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 93.89%. Comparing base (cfde13d) to head (df4b1cd).
Report is 2 commits behind head on main.

❗ Current head df4b1cd differs from pull request most recent head 1510f15. Consider uploading reports for the commit 1510f15 to get more accurate results

Files Patch % Lines
lamindb/core/_sync_git.py 88.88% 6 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1493      +/-   ##
==========================================
- Coverage   93.89%   93.89%   -0.01%     
==========================================
  Files          44       45       +1     
  Lines        4423     4501      +78     
==========================================
+ Hits         4153     4226      +73     
- Misses        270      275       +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Mar 13, 2024

@github-actions github-actions bot temporarily deployed to pull request March 13, 2024 20:28 Inactive
@github-actions github-actions bot temporarily deployed to pull request March 13, 2024 21:55 Inactive
@falexwolf falexwolf changed the title ✨ Integrate git with lamindb ✨ Integrate lamindb with git Mar 13, 2024
@github-actions github-actions bot temporarily deployed to pull request March 13, 2024 22:20 Inactive
@github-actions github-actions bot temporarily deployed to pull request March 13, 2024 22:33 Inactive
@falexwolf falexwolf merged commit 5886b87 into main Mar 13, 2024
8 checks passed
@falexwolf falexwolf deleted the syncgit branch March 13, 2024 23:04
@github-actions github-actions bot temporarily deployed to pull request March 13, 2024 23:11 Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant