Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the original url host feature to the score call #4084

Closed
wants to merge 100 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
100 commits
Select commit Hold shift + click to select a range
8135faa
Add the original url host feature to the score call
jacksonh Jun 20, 2024
84fccea
Send the full URL and let the service parse to host
jacksonh Jun 20, 2024
1d4b6c5
remove redundant context type
sywhb Jun 20, 2024
4dbdaa6
show archived highlights
sywhb Jun 20, 2024
d43e0e7
add more subscription features to the score api payload
sywhb Jun 20, 2024
bbd3a00
Update digest-score to run new model
jacksonh Jun 20, 2024
5852491
Clean up
jacksonh Jun 20, 2024
3807115
Linting clean ups
jacksonh Jun 21, 2024
a24dfe9
Remove test change
jacksonh Jun 21, 2024
51d2299
Start to use nav return in most places to return to the previous libr…
jacksonh Jun 21, 2024
e3b8f31
Better event handling on home action icons
jacksonh Jun 21, 2024
d5bf3b2
Prevent shift when unsubscribe button is presented on hover cards
jacksonh Jun 21, 2024
bcc527a
Show ten top picks at once
jacksonh Jun 21, 2024
cdc8a70
Make the display settings respect theme
jacksonh Jun 21, 2024
e277988
Rename web container files
jacksonh Jun 21, 2024
b6361dc
Implement actions on the home view
jacksonh Jun 21, 2024
981f3d7
Make sure recently added has a max of two lines
jacksonh Jun 21, 2024
aeb1a96
Add hover bg for apollo, implement share
jacksonh Jun 21, 2024
7321724
fix: lint migration github action failed for pull request from contri…
sywhb Jun 21, 2024
6ec9dbb
create a test migration sql
sywhb Jun 21, 2024
ef32ad0
replace set-output command with github env var
sywhb Jun 21, 2024
12a90e8
more testing
sywhb Jun 21, 2024
fd29a73
use github env var correctly
sywhb Jun 21, 2024
c496bc9
fix typo
sywhb Jun 21, 2024
165aa47
more testing
sywhb Jun 21, 2024
6fadd48
more testing
sywhb Jun 21, 2024
4c5cead
remove testing sql
sywhb Jun 21, 2024
55635aa
Alter omnivore_admin role to prevent omnivore_admin to be inherited b…
sywhb Jun 21, 2024
b556f7d
Skip scoring RSS items for now
sywhb Jun 21, 2024
35ba497
use real scoring service
sywhb Jun 21, 2024
7d1b025
add replication config
sywhb Jun 21, 2024
5cd8db0
use read replica for "read"
sywhb Jun 21, 2024
177aa2e
revert change to typeorm
sywhb Jun 21, 2024
04ce76d
fix permission error when drop role omnivore_admin
sywhb Jun 21, 2024
50ae678
Fix a typo|修改一个错别字
holton-jiang Jun 11, 2024
69fbd12
Fix some typos|修改部分错别字
holton-jiang Jun 11, 2024
bdf664d
Fix some typos|修改部分錯別字
holton-jiang Jun 11, 2024
c8462af
Filtering on the library view
jacksonh Jun 25, 2024
eab9c65
Dont revalidate shortcuts on focus to reduce flicker
jacksonh Jun 25, 2024
694bc34
Calc total menu height so there are not multiple scrollbars, add bg b…
jacksonh Jun 25, 2024
069a1fa
Hover on the highlight cards
jacksonh Jun 25, 2024
e00dd8f
Dont shrink left menu spacer when resizing
jacksonh Jun 25, 2024
5f774e1
Only indent the search bar in compact mode if the menu is closed
jacksonh Jun 25, 2024
612d869
Remove unused
jacksonh Jun 25, 2024
8b4c7c7
Add missing icon
jacksonh Jun 25, 2024
7482e58
Use an action so we can update local cache when moving to inbox
jacksonh Jun 25, 2024
288a6fc
Update action
jacksonh Jun 25, 2024
13f6652
refactor onboarding
stefanosansone Jun 23, 2024
073405a
add user creation screen to onboarding navhost
stefanosansone Jun 23, 2024
de3861e
bump version
stefanosansone Jun 23, 2024
5843857
add right to left text support
stefanosansone Jun 23, 2024
92400a2
align saved card items
stefanosansone Jun 23, 2024
84e95f2
Improve layout of highlights on smaller screens
jacksonh Jun 25, 2024
647b227
Remove right padding on search bar in small screens
jacksonh Jun 25, 2024
db5445e
Improve smaller screen layouts
jacksonh Jun 25, 2024
6607631
add "canMove" field to the HomeItem type in graphql api which indicat…
sywhb Jun 25, 2024
35a029f
Add move operation to home, fix query inputs
jacksonh Jun 25, 2024
f11a636
Use web return on logo click
jacksonh Jun 25, 2024
3e959cb
set nav-return more often
jacksonh Jun 25, 2024
4fcaae1
Implement dismiss on click for the new navigation menu
jacksonh Jun 25, 2024
08da78f
Add empty trash
jacksonh Jun 25, 2024
afadbe9
Better empty state handling for home
jacksonh Jun 25, 2024
2bbbc3a
Remove extra setter
jacksonh Jun 25, 2024
630d405
fix: Use shared UserDefaults instead of standard set to fix self-host…
maa-x Jun 25, 2024
eb413ce
Dont provide search base anymore as thats acheived by the folder
jacksonh Jun 26, 2024
22cded3
rename slave to replica in db config
sywhb Jun 26, 2024
c063555
Add internal function for refreshing features and model
jacksonh Jun 26, 2024
240cd9d
return empty array if no candidates for home feed selection
sywhb Jun 26, 2024
5245d2d
add postgres-replica to the docker-compose
sywhb Jun 26, 2024
0ef34b9
fix read replica not being used
sywhb Jun 26, 2024
1dcb62b
log isReplicated for each query
sywhb Jun 26, 2024
249d355
by default use info level for loggers
sywhb Jun 26, 2024
637698b
update setup.sh
sywhb Jun 26, 2024
c83afac
fix: validate ownership of library item before assigning labels to th…
sywhb Jun 28, 2024
fe9a683
fix tests
sywhb Jun 28, 2024
0e5132a
fix tests
sywhb Jun 28, 2024
6d3c4cc
use read replica for raw query
sywhb Jun 27, 2024
1c8b6a2
tidy
sywhb Jun 18, 2024
de23e9d
resolve conflicts
sywhb Jun 27, 2024
4886855
allow defining replica mode in the auth transaction
sywhb Jun 27, 2024
dc7e534
use primary and replica instead of master and slave
sywhb Jun 27, 2024
c9b6452
use read replica for selecting library items, labels and highlights
sywhb Jun 27, 2024
a34b705
cont
sywhb Jun 27, 2024
132a78c
fix: digest score api timeout = 5 seconds
sywhb Jun 28, 2024
665132b
fix: returns a stub score (0) in case score api throws an error
sywhb Jul 1, 2024
d5a76da
do not update library item score if 0
sywhb Jul 1, 2024
6dfd688
observe digest-score api lantency in prometheus
sywhb Jul 1, 2024
43fa422
observe failed digest-score api call lantency in prometheus too
sywhb Jul 1, 2024
3fda17a
remove initial observation
sywhb Jul 1, 2024
5c66e56
Update deps to resolve iOS18 issues
jacksonh Jul 1, 2024
2697803
Bump braces from 3.0.2 to 3.0.3 in /pkg/admin
dependabot[bot] Jun 12, 2024
7988d0d
Bump @grpc/grpc-js from 1.8.21 to 1.8.22
dependabot[bot] Jun 11, 2024
3c8f929
fix: returns a stub score (0) in case score api throws an error
sywhb Jul 1, 2024
0b940c7
return not_found if database is not found in notion
sywhb Jul 1, 2024
7e48e03
show an error message on web if notion database is not found
sywhb Jul 1, 2024
23839b3
Bump bullmq from 5.1.3 to 5.8.3
dependabot[bot] Jul 1, 2024
58a62ac
WIP: download android PDFs for offline to internal storage
jacksonh Jul 1, 2024
add0d01
Skip download of PDFs that are already downloaded
jacksonh Jul 1, 2024
35517c7
Refresh data outside of main because flask loads this script in produ…
jacksonh Jul 1, 2024
e9b006b
Android release 0.218.0
jacksonh Jul 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions packages/api/src/jobs/score_library_item.ts
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ export const scoreLibraryItem = async (
[libraryItem.id]: {
library_item_id: libraryItem.id,
title: libraryItem.title,
original_url_host: getHostFromUrl(libraryItem.originalUrl),
has_thumbnail: !!libraryItem.thumbnail,
has_site_icon: !!libraryItem.siteIcon,
saved_at: libraryItem.savedAt,
Expand Down Expand Up @@ -88,3 +89,16 @@ export const scoreLibraryItem = async (
logger.error('Failed to enqueue update home job', error)
}
}

const getHostFromUrl = (input?: string): string | undefined => {
if (typeof input !== 'string') {
return undefined
}

try {
const url = new URL(input)
return url.host
} catch (error) {
return undefined
}
}
Loading