immich/server/src/dtos
Mert 64636c0618
feat(server): near-duplicate detection (#8228)
* duplicate detection job, entity, config

* queueing

* job panel, update api

* use embedding in db instead of fetching

* disable concurrency

* only queue visible assets

* handle multiple duplicateIds

* update concurrent queue check

* add provider

* add web placeholder, server endpoint, migration, various fixes

* update sql

* select embedding by default

* rename variable

* simplify

* remove separate entity, handle re-running with different threshold, set default back to 0.02

* fix tests

* add tests

* add index to entity

* formatting

* update asset mock

* fix `upsertJobStatus` signature

* update sql

* formatting

* default to 0.03

* optimize clustering

* use asset's `duplicateId` if present

* update sql

* update tests

* expose admin setting

* refactor

* formatting

* skip if ml is disabled

* debug trash e2e

* remove from web

* remove from sidebar

* test if ml is disabled

* update sql

* separate duplicate detection from clip in config, disable by default for now

* fix doc

* lower minimum `maxDistance`

* update api

* Add and Use Duplicate Detection Feature Flag (#9364)

* Add Duplicate Detection Flag

* Use Duplicate Detection Flag

* Attempt Fixes for Failing Checks

* lower minimum `maxDistance`

* fix tests

---------

Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>

* chore: fixes and additions after rebase

* chore: update api (remove new Role enum)

* fix: left join smart search so getAll works without machine learning

* test: trash e2e go back to checking length of assets is zero

* chore: regen api after rebase

* test: fix tests after rebase

* redundant join

---------

Co-authored-by: Nicholas Flamy <30300649+NicholasFlamy@users.noreply.github.com>
Co-authored-by: Zack Pollard <zackpollard@ymail.com>
Co-authored-by: Zack Pollard <zack@futo.org>
2024-05-16 18:08:37 +01:00
..
activity.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
album-response.dto.spec.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
album.dto.ts chore(server): remove unused deps (#9334) 2024-05-08 16:39:35 -04:00
api-key.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
asset-ids.response.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
asset-response.dto.ts fix(server): show partners archived photos on mobile timeline (#9194) 2024-05-06 22:49:56 -05:00
asset-v1-response.dto.ts chore(server): remove unusuned endpoint/service/interface in asset-v1 (#9086) 2024-04-26 01:02:04 -05:00
asset-v1.dto.ts feat(server): read-write external assets (#9235) 2024-05-03 15:34:57 -04:00
asset.dto.ts chore(server): rename domain repositories -> interfaces (#8147) 2024-03-21 06:59:49 -05:00
audit.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
auth.dto.ts refactor(server): auth route metadata (#9344) 2024-05-09 13:58:44 -04:00
download.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
exif.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
job.dto.ts feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
library.dto.ts chore(server): remove unused property (#9521) 2024-05-15 15:17:48 -04:00
memory.dto.ts feat: persistent memories (#8330) 2024-04-02 10:23:17 -04:00
model-config.dto.ts feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
partner.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
person.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
search.dto.ts feat(server, web): include pictures of shared albums on map (#7439) 2024-05-13 09:28:57 -04:00
server-info.dto.ts feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
session.dto.ts refactor(server): sessions (#8915) 2024-04-19 06:47:29 -04:00
shared-link.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
stack.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
sync.dto.ts fix(server): stacked assets for full sync, userIds as array for delta sync (#9100) 2024-04-28 23:24:21 -04:00
system-config.dto.ts feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
system-metadata.dto.ts refactor: system metadata (#8923) 2024-04-19 20:36:15 -04:00
tag.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
time-bucket.dto.ts chore(server): rename domain repositories -> interfaces (#8147) 2024-03-21 06:59:49 -05:00
user-profile.dto.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
user.dto.spec.ts chore(server): move dtos (#8131) 2024-03-20 23:53:07 +01:00
user.dto.ts feat(server): email notifications (#8447) 2024-05-02 15:43:18 +01:00