-
Notifications
You must be signed in to change notification settings - Fork 5
Extract all images and add to lancedb #51
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
d33bs
wants to merge
18
commits into
WayScience:main
Choose a base branch
from
d33bs:image-extraction
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
18 commits
Select commit
Hold shift + click to select a range
b708f46
remove limit
d33bs 9530cfe
updates
d33bs 0ddffc1
update for example work
d33bs a39f151
remove limit
d33bs a13d27e
union by name instead of order
d33bs ba9f321
update to filter frames by end result
d33bs 07704bd
fallback for sql changes; use zero index for frame
d33bs 4ffa45c
zero index the frame
d33bs 020e6bf
fix data ref issue
d33bs 0da0eea
update for illumination correction and debug
d33bs b4f8b62
specify z = 0 to avoid z-stacked animations
d33bs 3650bd3
typo and dynamic ingest for ic
d33bs 7a2f2ac
change for 0th index
d33bs d8127b4
avoid negative frames
d33bs 0149c72
avoid negative frames
d33bs b36485d
use zero-index for the movie len
d33bs 62062c6
try to update context frames
d33bs 823766b
correct the frame label
d33bs File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -22,3 +22,7 @@ __pycache__/ | |
| # data packaging ignores | ||
| 5.data_packaging/packaged | ||
| 5.data_packaging/images | ||
|
|
||
| *.txt | ||
| *.csv | ||
| *.parquet | ||
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,42 @@ | ||
| # --- | ||
| # jupyter: | ||
| # jupytext: | ||
| # text_representation: | ||
| # extension: .py | ||
| # format_name: light | ||
| # format_version: '1.5' | ||
| # jupytext_version: 1.18.1 | ||
| # kernelspec: | ||
| # display_name: Python 3 (ipykernel) | ||
| # language: python | ||
| # name: python3 | ||
| # --- | ||
|
|
||
| # # Example for using packaged data | ||
| # | ||
| # This notebook shows how to use the packaged data from this project. | ||
|
|
||
| # + | ||
| import lancedb | ||
| from serpula_rasa.image import show_images_from_lance | ||
|
|
||
| # setup a connection to lancedb | ||
| ldb = lancedb.connect(uri=(lance_dir := "packaged/lancedb/mitocheck_data")) | ||
| # - | ||
|
|
||
| # show all table names | ||
| # note: all table names include numbers corresponing to the step they came from. | ||
| ldb.table_names(limit=20) | ||
|
|
||
| ldb.open_table(name="5.data_packaging.location_and_ch5_frame_image_data").to_pandas().head() | ||
|
|
||
| show_images_from_lance( | ||
| db_path=lance_dir, | ||
| table_name="5.data_packaging.location_and_ch5_frame_image_data", | ||
| col_name="ome-arrow_original", | ||
| max_images=20, | ||
| pick="first", | ||
| cmap="gray", | ||
| base_size=10, | ||
| cols=1, | ||
| ) |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Global ignore patterns are too broad and will exclude important files.
Adding
*.txt,*.csv, and*.parquetas global patterns will ignore these file types across the entire repository, including:This could prevent critical files from being tracked and cause confusion for contributors.
✏️ Suggested fix: Scope patterns to specific directories
Replace the global patterns with directory-scoped patterns:
Or scope them to the specific subdirectories where these artifacts are generated:
🤖 Prompt for AI Agents