Findling Search - Releases

Added

• Mails (.eml): subject, sender, recipients, text and the names of attachments; attachment content is not read.
• ZIP files: the text of the files inside, without OCR, within fixed limits (docs/formats.md); a ZIP file stands in no type filter group.
• Word 97 to 2003 (.doc) and Excel 97 to 2003 (.xls), read without LibreOffice; .xls under the cell limit of XLSX.
• HEIC and HEIF photos through OCR.
• The excerpt of a hit inside a ZIP file names the inner file.
• A one time catch up after the upgrade, without a full reindex: files of the new types, old Word and Excel files under OOXML names, and files given up as repeatedly stuck are read once more.
• Czech as a search language, without stemming, and Czech OCR; OCR offers ten languages (docs/language-analyzers.md).
• Unified search: filter Findling hits by type group (six entries) or by folder, sub folders included; unknown values are ignored (docs/search-filters.md).
• Exclusion patterns with * and ? on the admin page, for example Mac bundles (*.photoslibrary) or build folders (*/node_modules/*); existing folder exclusions keep working. At most 32 patterns of 60 characters (docs/admin-page.md) (#22).
• The admin page shows the limits per file read only, with how to change them (#21).
• A migration page from fulltextsearch/Elasticsearch in German, English and French (docs/migrate-from-fulltextsearch.md).
• A banner on the admin page while fulltextsearch or files_fulltextsearch is enabled, with a link to that page.
• Similar documents: a link at every hit on the results page lists up to ten files with related content, only files the user can read.
• Hostile files end as skipped with the new code blocked_malicious and a detail code on the admin page (zip_ratio, zip_overlap, zip_traversal, package_entries, xml_entities, image_pixels, mail_nesting, cfb_cycle); files that are only large keep their old verdict (docs/formats.md).
• Index hygiene: documents of deleted users and deleted storages leave the index at the next reconcile; a storage that still exists in Nextcloud but is no longer mounted leaves after 30 days.
• Releases carry the source of the tag and the four corresponding source packages of the native libraries in the image.

Changed

• Files under a rule leave the index at the next reconcile even when they did not change, and their old entries leave the error list (#22).
• The hint about too little hardware for a profile is reworded in all languages.
• The httpx and httpcore loggers run at WARNING in the image, so file ids and user ids no longer appear in the standard log; DEBUG still shows them.
• Store texts: the Standard profile frees at most half of the machine the backend runs on (was: half of the box).

Fixed

• A file whose size in Nextcloud's file cache is larger than the file is now read when two downloads agree, instead of ending as repeatedly stuck (POL-02, F-29-03).

Fixed

• Result page: scrolling works again when results exceed the window height (#27).

Fixed

• The coverage denominator no longer counts storages that left the mount list: frozen rows of an old mount configuration padded it forever and the page answered 7 per cent on an instance whose coverage was complete (#25). The rows themselves stay, only the figure stops reading them.
• When external storages are mounted once per user, the same share is counted once per mount. The page now says so, in a sentence that appears only when everything is settled and a gap remains; a real dedup per mount configuration is a candidate for 1.5 because it has to answer the ACL question first (#25).

Added

• SECURITY.md with the two private reporting channels, CONTRIBUTING.md, and issue and pull request templates.
• CI security scans: CodeQL over the Python half and pip-audit over the locked dependency set, weekly on top of every push.
• This changelog; it travels with both store archives from the next release.
• docs/privacy.md: what is stored where, who can read it, the remedies (host disk encryption, a deliberate backup policy), and why the app does not roll its own index encryption. The READMEs also name the lockstep guard: on a major or minor version mismatch between the two apps, the search answers with nothing instead of possibly wrong results.
• A weekly OpenSSF Scorecard run that publishes its result; the README carries the badge.

Added

• Mails (.eml): subject, sender, recipients, text and the names of attachments; attachment content is not read.
• ZIP files: the text of the files inside, without OCR, within fixed limits (docs/formats.md); a ZIP file stands in no type filter group.
• Word 97 to 2003 (.doc) and Excel 97 to 2003 (.xls), read without LibreOffice; .xls under the cell limit of XLSX.
• HEIC and HEIF photos through OCR.
• The excerpt of a hit inside a ZIP file names the inner file.
• A one time catch up after the upgrade, without a full reindex: files of the new types, old Word and Excel files under OOXML names, and files given up as repeatedly stuck are read once more.
• Czech as a search language, without stemming, and Czech OCR; OCR offers ten languages (docs/language-analyzers.md).
• Unified search: filter Findling hits by type group (six entries) or by folder, sub folders included; unknown values are ignored (docs/search-filters.md).
• Exclusion patterns with * and ? on the admin page, for example Mac bundles (*.photoslibrary) or build folders (*/node_modules/*); existing folder exclusions keep working. At most 32 patterns of 60 characters (docs/admin-page.md) (#22).
• The admin page shows the limits per file read only, with how to change them (#21).
• A migration page from fulltextsearch/Elasticsearch in German, English and French (docs/migrate-from-fulltextsearch.md).
• A banner on the admin page while fulltextsearch or files_fulltextsearch is enabled, with a link to that page.
• Similar documents: a link at every hit on the results page lists up to ten files with related content, only files the user can read.
• Hostile files end as skipped with the new code blocked_malicious and a detail code on the admin page (zip_ratio, zip_overlap, zip_traversal, package_entries, xml_entities, image_pixels, mail_nesting, cfb_cycle); files that are only large keep their old verdict (docs/formats.md).
• Index hygiene: documents of deleted users and deleted storages leave the index at the next reconcile; a storage that still exists in Nextcloud but is no longer mounted leaves after 30 days.
• Releases carry the source of the tag and the four corresponding source packages of the native libraries in the image.

Changed

• Files under a rule leave the index at the next reconcile even when they did not change, and their old entries leave the error list (#22).
• The hint about too little hardware for a profile is reworded in all languages.
• The httpx and httpcore loggers run at WARNING in the image, so file ids and user ids no longer appear in the standard log; DEBUG still shows them.
• Store texts: the Standard profile frees at most half of the machine the backend runs on (was: half of the box).

Fixed

• A file whose size in Nextcloud's file cache is larger than the file is now read when two downloads agree, instead of ending as repeatedly stuck (POL-02, F-29-03).

Fixed

• Result page: scrolling works again when results exceed the window height (#27).

Fixed

• The coverage denominator no longer counts storages that left the mount list: frozen rows of an old mount configuration padded it forever and the page answered 7 per cent on an instance whose coverage was complete (#25). The rows themselves stay, only the figure stops reading them.
• When external storages are mounted once per user, the same share is counted once per mount. The page now says so, in a sentence that appears only when everything is settled and a gap remains; a real dedup per mount configuration is a candidate for 1.5 because it has to answer the ACL question first (#25).

Added

• SECURITY.md with the two private reporting channels, CONTRIBUTING.md, and issue and pull request templates.
• CI security scans: CodeQL over the Python half and pip-audit over the locked dependency set, weekly on top of every push.
• This changelog; it travels with both store archives from the next release.
• docs/privacy.md: what is stored where, who can read it, the remedies (host disk encryption, a deliberate backup policy), and why the app does not roll its own index encryption. The READMEs also name the lockstep guard: on a major or minor version mismatch between the two apps, the search answers with nothing instead of possibly wrong results.
• A weekly OpenSSF Scorecard run that publishes its result; the README carries the badge.