Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Krokiet: similar issue scan stuck #1442

Open
Quackdoc opened this issue Feb 5, 2025 · 1 comment
Open

Krokiet: similar issue scan stuck #1442

Quackdoc opened this issue Feb 5, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@Quackdoc
Copy link

Quackdoc commented Feb 5, 2025

Bug Description
Image hasing stuck on sshfs

Steps to reproduce:

  1. mount sshfs sshfs -p 8022 $TERMUX-USER@$PHONE-IP:/storage/emulated/0/Pictures /mnt
  2. prefer image similarity scan on /mnt

Terminal output (optional):

This typically happens long before hashing gets stuck, happens near the beginning of the similar issue scan

thread '<unnamed>' panicked at /home/quack/.cargo/registry/src/index.crates.io-6f17d22bba15001f/nom-exif-2.1.0/src/exif/exif_exif.rs:235:5:
assertion failed: data.len() >= 6
stack backtrace:
   0: rust_begin_unwind
   1: core::panicking::panic_fmt
   2: core::panicking::panic
   3: nom_exif::jpeg::extract_exif_data
   4: nom_exif::exif::extract_exif_range
   5: nom_exif::parser::BufParser::load_and_parse
   6: <nom_exif::exif::exif_iter::ExifIter as nom_exif::parser::ParseOutput<R,S>>::parse
   7: nom_exif::parser::MediaParser::parse
   8: czkawka_core::common_image::get_rotation_from_exif
   9: czkawka_core::common_image::get_dynamic_image_from_path
  10: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::next
  11: rayon::iter::plumbing::Folder::consume_iter
  12: rayon::iter::plumbing::bridge_producer_consumer::helper
  13: rayon_core::join::join_context::{{closure}}
  14: rayon_core::registry::in_worker
  15: rayon::iter::plumbing::bridge_producer_consumer::helper
  16: rayon_core::join::join_context::{{closure}}
  17: rayon_core::registry::in_worker
  18: rayon::iter::plumbing::bridge_producer_consumer::helper
  19: rayon_core::join::join_context::{{closure}}
  20: rayon_core::registry::in_worker
  21: rayon::iter::plumbing::bridge_producer_consumer::helper
  22: rayon_core::join::join_context::{{closure}}
  23: rayon_core::registry::in_worker
  24: rayon::iter::plumbing::bridge_producer_consumer::helper
  25: rayon_core::join::join_context::{{closure}}
  26: rayon_core::registry::in_worker
  27: rayon::iter::plumbing::bridge_producer_consumer::helper
  28: rayon_core::join::join_context::{{closure}}
  29: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute
  30: rayon_core::registry::WorkerThread::wait_until_cold
  31: rayon_core::registry::ThreadBuilder::run
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Debug log

I have edited out the terminal color stuff

09:45:07.112 [INFO] czkawka_core::common: App version: 8.0.0, release mode, rust 1.83.0 (2024-11-26), os Arch Linux Rolling Release [x86_64 64-bit], 12 cpu/threads, features(0): []
09:45:07.254 [DEBUG] krokiet::settings: Loading data from file "/home/quack/.config/krokiet/config_general.json" took 22.111µs
09:45:07.254 [DEBUG] krokiet::settings: Loading and converting data from file "/home/quack/.config/krokiet/config_general.json" took 55.945µs
09:45:07.254 [DEBUG] krokiet::settings: Loading data from file "/home/quack/.config/krokiet/config_preset_0.json" took 11.421µs
09:45:07.254 [DEBUG] krokiet::settings: Loading and converting data from file "/home/quack/.config/krokiet/config_preset_0.json" took 29.716µs
09:45:07.254 [DEBUG] czkawka_core::common: Number of threads set to 0 (0 - means that all available threads will be used)
09:45:17.174 [INFO] czkawka_core::similar_images: find_similar_images
09:45:17.174 [DEBUG] czkawka_core::similar_images: check_for_similar_images
09:45:17.174 [DEBUG] czkawka_core::common_dir_traversal: run(collecting files/dirs)
09:45:19.634 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads
09:45:19.644 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads: Done in 9.59ms
09:45:19.644 [DEBUG] czkawka_core::common_dir_traversal: Collected 11884 files
09:45:19.644 [DEBUG] czkawka_core::common_dir_traversal: run(collecting files/dirs): Done in 2.47s
09:45:19.654 [DEBUG] czkawka_core::similar_images: check_files - Found 11884 image files.
09:45:19.654 [DEBUG] czkawka_core::similar_images: check_for_similar_images: Done in 2.48s
09:45:19.654 [DEBUG] czkawka_core::similar_images: hash_images
09:45:19.654 [DEBUG] czkawka_core::similar_images: hash_images_load_cache
09:45:19.654 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized_by_path
09:45:19.654 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized
09:45:19.655 [DEBUG] czkawka_core::common_cache: Starting removing outdated cache entries (removing non existent files from cache - true)
09:45:19.655 [DEBUG] czkawka_core::common_cache: Completed removing outdated cache entries, removed 0 out of all 388 entries
09:45:19.655 [DEBUG] czkawka_core::common_cache: Loaded cache from file cache_similar_images_8_Mean_Lanczos3_90.bin (or json alternative) - 388 results
09:45:19.655 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized: Done in 970.85µs
09:45:19.655 [DEBUG] czkawka_core::common_cache: Converting cache Vec<T> into BTreeMap<String, T>
09:45:19.656 [DEBUG] czkawka_core::common_cache: Converted cache Vec<T> into BTreeMap<String, T>
09:45:19.656 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized_by_path: Done in 1.20ms
09:45:19.656 [DEBUG] czkawka_core::similar_images: hash_images-load_cache - starting calculating diff
09:45:19.664 [DEBUG] czkawka_core::similar_images: hash_images_load_cache - completed diff between loaded and prechecked files, 11496(10.28 GiB) - non cached, 388(265.24 MiB) - already cached
09:45:19.664 [DEBUG] czkawka_core::similar_images: hash_images_load_cache: Done in 9.77ms
09:45:19.664 [DEBUG] czkawka_core::similar_images: hash_images - start hashing images

System

  • Czkawka/Krokiet version: commit: 1c99adb
  • OS version: Arch Linux
  • Installation method: Compiled

Is there a "image hash log" that I could check to see what images has failed to be hashed that I could manually deal with?

@Quackdoc Quackdoc added the bug Something isn't working label Feb 5, 2025
@Quackdoc
Copy link
Author

Quackdoc commented Feb 5, 2025

I updated to the latest commit: 1a10059 and am getting the below crash

thread '<unknown>' has overflowed its stack
fatal runtime error: stack overflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant