Skip to content

AcqImageList

Ordered collection of loaded acquisition files.

AcqImageList is the preferred entry point when a workflow operates on more than one acquisition. It can load a single file, discover supported files under a folder, or load file paths from a CSV. Files are stored in stable display order and can be accessed by file identifier, index, or iteration.

The constructor is strict and raises when loading fails. Use :meth:load_safe for GUI-style workflows that should return partial results and non-fatal warnings instead of failing the entire load.

Examples:

Load a folder and iterate files::

from acqstore.acq_image.acq_image_list import AcqImageList

images = AcqImageList("/path/to/data")
for acq in images:
    print(acq.name, acq.file_id)

Safely load a folder and inspect warnings::

result = AcqImageList.load_safe(
    "/path/to/data",
    kind="folder",
    folder_depth=4,
)
images = result.acq_image_list
for warning in result.warnings:
    print(warning.message, warning.path)

Parameters:

Name Type Description Default
path str

File, folder, or CSV path.

required
file_factory Callable[[str], AcqImage] | None

Optional factory for creating AcqImage-like objects.

None
folder_depth int

Maximum directory depth used for folder discovery.

4
path_kind PathKind | str | None

Optional explicit PathKind. When omitted, the kind is inferred from the path.

None
load_images bool

Passed to default AcqImage construction. Ignored when a custom file_factory is supplied.

True
load_analysis_csv bool

Passed to default AcqImage construction. Ignored when a custom file_factory is supplied.

True
root_path str | Path | None

Optional manifest root for CSV loads. When omitted, CSV _rel_path values are resolved relative to the CSV parent.

None
Source code in src/acqstore/acq_image/acq_image_list.py
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
class AcqImageList:
    """Ordered collection of loaded acquisition files.

    ``AcqImageList`` is the preferred entry point when a workflow operates on
    more than one acquisition. It can load a single file, discover supported
    files under a folder, or load file paths from a CSV. Files are stored in
    stable display order and can be accessed by file identifier, index, or
    iteration.

    The constructor is strict and raises when loading fails. Use
    :meth:`load_safe` for GUI-style workflows that should return partial results
    and non-fatal warnings instead of failing the entire load.

    Examples:
        Load a folder and iterate files::

            from acqstore.acq_image.acq_image_list import AcqImageList

            images = AcqImageList("/path/to/data")
            for acq in images:
                print(acq.name, acq.file_id)

        Safely load a folder and inspect warnings::

            result = AcqImageList.load_safe(
                "/path/to/data",
                kind="folder",
                folder_depth=4,
            )
            images = result.acq_image_list
            for warning in result.warnings:
                print(warning.message, warning.path)

    Args:
        path: File, folder, or CSV path.
        file_factory: Optional factory for creating ``AcqImage``-like objects.
        folder_depth: Maximum directory depth used for folder discovery.
        path_kind: Optional explicit ``PathKind``. When omitted, the kind is
            inferred from the path.
        load_images: Passed to default ``AcqImage`` construction. Ignored when a
            custom ``file_factory`` is supplied.
        load_analysis_csv: Passed to default ``AcqImage`` construction. Ignored
            when a custom ``file_factory`` is supplied.
        root_path: Optional manifest root for CSV loads. When omitted, CSV
            ``_rel_path`` values are resolved relative to the CSV parent.
    """

    def __init__(
        self,
        path: str,
        *,
        file_factory: Callable[[str], AcqImage] | None = None,
        folder_depth: int = 4,
        path_kind: PathKind | str | None = None,
        load_images: bool = True,
        load_analysis_csv: bool = True,
        root_path: str | Path | None = None,
    ):
        """Load one file, a folder of files, or a CSV file list.

        Args:
            path: Filesystem path to one file, directory, or CSV file.
            file_factory: Optional factory for creating file objects. Defaults to
                ``AcqImage`` and is mainly useful for tests.
            folder_depth: When ``path`` is a directory, maximum directory depth to
                search (>= 1). Depth ``1`` is only the given folder; each increment
                includes one more level of child directories. Ignored when ``path`` is
                a file.
            path_kind: Optional explicit source type (``file``, ``folder``, or
                ``csv``). When omitted, the constructor infers kind from path
                suffix and filesystem checks.
            load_images: When true, default ``AcqImage`` construction eagerly
                loads primary pixels.
            load_analysis_csv: When true, default ``AcqImage`` construction
                eagerly loads analysis CSV result tables.
            root_path: Optional manifest root for CSV loads. When omitted, CSV
                ``_rel_path`` values are resolved relative to the CSV parent.

        Raises:
            ValueError: If ``folder_depth`` is less than one or strict CSV
                parsing fails.
            Exception: Propagates file-loader exceptions from ``AcqImage`` when
                any discovered file cannot be loaded.
        """
        self.path = str(path)
        self.source_root_path: str | None = None
        if folder_depth < 1:
            raise ValueError(f'folder_depth must be >= 1, got {folder_depth}')

        detected_kind: PathKind | str | None = path_kind
        if detected_kind is None:
            path_obj = Path(path)
            if path_obj.suffix.lower() == '.csv':
                detected_kind = PathKind.CSV
            elif os.path.isdir(path):
                detected_kind = PathKind.FOLDER
            else:
                detected_kind = PathKind.FILE

        if detected_kind == PathKind.FOLDER:
            self.source_root_path = str(Path(path).expanduser().resolve(strict=False))
            self.file_list = _build_file_list(path, get_allowed_import_extensions(), folder_depth=folder_depth)
        elif detected_kind == PathKind.CSV:
            csv_root = Path(root_path).expanduser() if root_path is not None else Path(path).expanduser().parent
            self.source_root_path = str(csv_root.resolve(strict=False))
            self.file_list = self._build_file_list_from_csv(path, root_path=csv_root)
        else:
            file_path = Path(path).expanduser().resolve(strict=False)
            self.source_root_path = str(file_path.parent)
            self.file_list = [str(file_path)]

        if file_factory is None:
            from acqstore.acq_image.acq_image import AcqImage

            def file_factory(file_path: str) -> AcqImage:
                return AcqImage(
                    file_path,
                    load_images=load_images,
                    load_analysis_csv=load_analysis_csv,
                )
        self._files = [file_factory(file_path) for file_path in self.file_list]
        self._files_by_id = {acq_file.file_id: acq_file for acq_file in self._files}
        self._attach_analysis_pools()

    @classmethod
    def load_safe(
        cls,
        path: str,
        *,
        kind: PathKind | str,
        file_factory: Callable[[str], AcqImage] | None = None,
        folder_depth: int = 4,
        progress_callback: Callable[[int, int, str], None] | None = None,
        should_cancel: Callable[[], bool] | None = None,
        load_images: bool = True,
        load_analysis_csv: bool = True,
        root_path: str | Path | None = None,
    ) -> LoadResult:
        """Load acquisition files while collecting non-fatal warnings.

        This is the preferred loading API for GUI, notebook, and batch workflows
        that should keep usable files even when one file fails. Missing files,
        bad CSV rows, and individual loader errors are returned as
        :class:`LoadWarning` records. Cancellation is cooperative and checked
        between file loads.

        Args:
            path: Input path supplied by the user or caller.
            kind: Explicit source kind (``file``, ``folder``, or ``csv``).
            file_factory: Optional file-construction callback for tests or
                dependency injection.
            folder_depth: Maximum folder traversal depth for folder loads.
            progress_callback: Optional callback called as
                ``progress_callback(completed, total, message)`` after discovery
                and after each attempted file load.
            should_cancel: Optional callback checked between file loads. Return
                ``True`` to cancel loading.
            load_images: When true, default ``AcqImage`` construction eagerly
                loads primary pixels.
            load_analysis_csv: When true, default ``AcqImage`` construction
                eagerly loads analysis CSV result tables.
            root_path: Optional manifest root used for CSV loads. When omitted,
                CSV ``_rel_path`` values are resolved relative to the CSV parent.

        Returns:
            :class:`LoadResult` containing an ``AcqImageList`` and collected
            warnings. The list may be empty.

        Raises:
            LoadCancelled: If ``should_cancel`` requests cancellation.
        """
        warnings: list[LoadWarning] = []
        path_obj = Path(path).expanduser()
        base_path = str(path_obj.resolve(strict=False))
        if isinstance(kind, str):
            try:
                kind = PathKind(kind)
            except ValueError:
                warnings.append(LoadWarning(message=f'Unsupported load kind: {kind}', path=base_path, error_type=LoadErrorType.CSV_ERROR))
                obj = cls.__new__(cls)
                obj.path = base_path
                obj.source_root_path = None
                obj.file_list = []
                obj._files = []
                obj._files_by_id = {}
                obj._attach_analysis_pools()
                return LoadResult(acq_image_list=obj, warnings=tuple(warnings), discovered_count=0)

        candidate_paths: list[str] = []
        if kind == PathKind.FOLDER:
            if not path_obj.exists() or not path_obj.is_dir():
                warnings.append(LoadWarning(message='Folder does not exist or is not a directory', path=base_path, error_type=LoadErrorType.MISSING_FILE))
            else:
                candidate_paths = _build_file_list(path_obj, get_allowed_import_extensions(), folder_depth=folder_depth)
        elif kind == PathKind.FILE:
            if not path_obj.exists() or not (path_obj.is_file() or path_has_allowed_import_extension(path_obj)):
                warnings.append(LoadWarning(message='File does not exist or is not a supported file/store', path=base_path, error_type=LoadErrorType.MISSING_FILE))
            else:
                candidate_paths = [str(path_obj.resolve())]
        elif kind == PathKind.CSV:
            csv_paths, csv_warnings = cls._build_file_list_from_csv_safe(path_obj, root_path=root_path)
            candidate_paths = csv_paths
            warnings.extend(csv_warnings)
        else:
            warnings.append(LoadWarning(message=f'Unsupported load kind: {kind}', path=base_path, error_type=LoadErrorType.CSV_ERROR))

        files: list[AcqImage] = []
        total = len(candidate_paths)
        if progress_callback is not None:
            progress_callback(0, total, f'Discovered {total} file(s)')
        for candidate in candidate_paths:
            if should_cancel is not None and should_cancel():
                raise LoadCancelled('Load cancelled')
            try:
                if file_factory is None:
                    from acqstore.acq_image.acq_image import AcqImage

                    built = AcqImage(
                        candidate,
                        load_images=load_images,
                        load_analysis_csv=load_analysis_csv,
                    )
                else:
                    built = file_factory(candidate)
                files.append(built)
            except Exception as exc:
                resolved_candidate = str(Path(candidate).resolve(strict=False))
                message = f'Failed to load file: {exc}'
                logger.error('%s: %s', message, resolved_candidate)
                warnings.append(LoadWarning(message=message, path=resolved_candidate, error_type=LoadErrorType.LOADER_ERROR, resolved_path=resolved_candidate))
            if progress_callback is not None:
                progress_callback(len(files), total, f'Loaded {len(files)}/{total}')

        obj = cls.__new__(cls)
        obj.path = base_path
        if kind == PathKind.FOLDER:
            obj.source_root_path = str(path_obj.resolve(strict=False))
        elif kind == PathKind.CSV:
            csv_root = Path(root_path).expanduser() if root_path is not None else path_obj.parent
            obj.source_root_path = str(csv_root.resolve(strict=False))
        elif kind == PathKind.FILE:
            obj.source_root_path = str(path_obj.resolve(strict=False).parent)
        else:
            obj.source_root_path = None
        obj.file_list = [str(Path(file.path).resolve(strict=False)) if hasattr(file, 'path') else file.file_id for file in files]
        obj._files = files
        obj._files_by_id = {acq_file.file_id: acq_file for acq_file in files}
        obj._attach_analysis_pools()
        return LoadResult(acq_image_list=obj, warnings=tuple(warnings), discovered_count=total)

    @classmethod
    def from_manifest_csv(
        cls,
        csv_path: str | Path,
        *,
        root_path: str | Path | None = None,
        file_factory: Callable[[str], AcqImage] | None = None,
        load_images: bool = True,
        load_analysis_csv: bool = True,
    ) -> LoadResult:
        """Safely load an acquisition list from a manifest CSV.

        Args:
            csv_path: CSV file containing a required ``_rel_path`` column.
            root_path: Optional manifest root. When omitted, paths are resolved
                relative to the CSV parent directory.
            file_factory: Optional file-construction callback for tests or
                dependency injection.
            load_images: When true, default ``AcqImage`` construction eagerly
                loads primary pixels.
            load_analysis_csv: When true, default ``AcqImage`` construction
                eagerly loads analysis CSV result tables.

        Returns:
            Structured load result containing the loaded list and warnings.

        Raises:
            LoadCancelled: Never raised by this wrapper because no cancellation
                callback is accepted.
        """
        return cls.load_safe(
            str(csv_path),
            kind=PathKind.CSV,
            file_factory=file_factory,
            load_images=load_images,
            load_analysis_csv=load_analysis_csv,
            root_path=root_path,
        )

    @staticmethod
    def _build_file_list_from_csv_safe(
        csv_path: Path,
        *,
        root_path: str | Path | None = None,
    ) -> tuple[list[str], list[LoadWarning]]:
        """Parse CSV ``_rel_path`` rows with per-row warnings.

        Args:
            csv_path: Manifest CSV path.
            root_path: Optional root directory for resolving ``_rel_path``.

        Returns:
            Tuple of candidate absolute paths and non-fatal warnings.
        """
        warnings: list[LoadWarning] = []
        result: list[str] = []
        csv_resolved = csv_path.expanduser().resolve(strict=False)
        if not csv_path.exists() or not csv_path.is_file():
            warning = LoadWarning(
                message='CSV file does not exist',
                path=str(csv_resolved),
                error_type=LoadErrorType.MISSING_FILE,
            )
            logger.error('%s: %s', warning.message, warning.path)
            return ([], [warning])

        manifest_root = (
            Path(root_path).expanduser().resolve(strict=False)
            if root_path is not None
            else csv_path.parent.resolve(strict=False)
        )
        if root_path is not None and (not manifest_root.exists() or not manifest_root.is_dir()):
            warning = LoadWarning(
                message='Manifest root_path does not exist or is not a directory',
                path=str(manifest_root),
                error_type=LoadErrorType.MISSING_FILE,
            )
            logger.error('%s: %s', warning.message, warning.path)
            return ([], [warning])

        try:
            with csv_path.open('r', encoding='utf-8', newline='') as handle:
                reader = csv.DictReader(handle)
                if reader.fieldnames is None or '_rel_path' not in reader.fieldnames:
                    warnings.append(
                        LoadWarning(
                            message='CSV is missing required column "_rel_path"',
                            path=str(csv_resolved),
                            error_type=LoadErrorType.CSV_ERROR,
                        )
                    )
                    return ([], warnings)
                seen_rel_paths: set[str] = set()
                for index, row in enumerate(reader, start=2):
                    raw_value = row.get('_rel_path')
                    if raw_value is None or not str(raw_value).strip():
                        warnings.append(
                            LoadWarning(
                                message='CSV row has blank _rel_path',
                                path=str(csv_resolved),
                                row_index=index,
                                error_type=LoadErrorType.CSV_ERROR,
                            )
                        )
                        continue
                    rel_value = str(raw_value).strip()
                    rel_path = Path(rel_value)
                    if rel_path.is_absolute():
                        warnings.append(
                            LoadWarning(
                                message='CSV _rel_path must be relative',
                                path=str(csv_resolved),
                                row_index=index,
                                error_type=LoadErrorType.CSV_ERROR,
                                rel_path=rel_value,
                            )
                        )
                        continue
                    if rel_value in seen_rel_paths:
                        warnings.append(
                            LoadWarning(
                                message='CSV contains duplicate _rel_path',
                                path=str(csv_resolved),
                                row_index=index,
                                error_type=LoadErrorType.CSV_ERROR,
                                rel_path=rel_value,
                            )
                        )
                        continue
                    seen_rel_paths.add(rel_value)
                    candidate = (manifest_root / rel_path).resolve(strict=False)
                    try:
                        candidate.relative_to(manifest_root)
                    except ValueError:
                        warnings.append(
                            LoadWarning(
                                message='CSV _rel_path escapes manifest root',
                                path=str(csv_resolved),
                                row_index=index,
                                error_type=LoadErrorType.CSV_ERROR,
                                rel_path=rel_value,
                                resolved_path=str(candidate),
                            )
                        )
                        continue
                    if not candidate.exists() or not (candidate.is_file() or path_has_allowed_import_extension(candidate)):
                        warning = LoadWarning(
                            message='CSV _rel_path target does not exist',
                            path=str(candidate),
                            row_index=index,
                            error_type=LoadErrorType.MISSING_FILE,
                            rel_path=rel_value,
                            resolved_path=str(candidate),
                        )
                        logger.error('%s: %s', warning.message, warning.path)
                        warnings.append(warning)
                        continue
                    if not path_has_allowed_import_extension(candidate):
                        warning = LoadWarning(
                            message='CSV _rel_path target is not a supported file/store',
                            path=str(candidate),
                            row_index=index,
                            error_type=LoadErrorType.UNSUPPORTED_FILE_TYPE,
                            rel_path=rel_value,
                            resolved_path=str(candidate),
                        )
                        logger.error('%s: %s', warning.message, warning.path)
                        warnings.append(warning)
                        continue
                    result.append(str(candidate))
        except Exception as exc:
            warnings.append(
                LoadWarning(
                    message=f'Failed to parse CSV: {exc}',
                    path=str(csv_resolved),
                    error_type=LoadErrorType.CSV_ERROR,
                )
            )
            return ([], warnings)

        return (result, warnings)

    def _build_file_list_from_csv(
        self,
        path: str | Path,
        *,
        root_path: str | Path | None = None,
    ) -> list[str]:
        """Strict CSV parser used by constructor path-kind csv mode.

        Args:
            path: Manifest CSV path.
            root_path: Optional root directory for resolving ``_rel_path``.

        Returns:
            Absolute candidate file paths.

        Raises:
            ValueError: If manifest parsing produces any warning.
        """
        paths, warnings = self._build_file_list_from_csv_safe(Path(path), root_path=root_path)
        if warnings:
            first = warnings[0]
            raise ValueError(first.message)
        return paths

    def to_manifest_csv(
        self,
        csv_path: str | Path,
        *,
        root_path: str | Path | None = None,
    ) -> Path:
        """Write all files in this list to a manifest CSV.

        Args:
            csv_path: Destination CSV path.
            root_path: Optional root used to compute ``_rel_path`` values.

        Returns:
            Resolved destination path.

        Raises:
            ValueError: If a file path cannot be represented relative to the
                effective root.
            OSError: If writing fails.
        """
        from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

        return AcqImageListManifest(self).write_manifest_csv(csv_path, root_path=root_path)

    def to_randomized_manifest_master_csv(
        self,
        csv_path: str | Path,
        *,
        groupby_column: str,
        random_seed: int | None = None,
        root_path: str | Path | None = None,
    ) -> Path:
        """Write the full deterministic randomized manifest for this list.

        Args:
            csv_path: Destination CSV path.
            groupby_column: Schema row column used to define groups.
            random_seed: Optional seed for deterministic shuffling.
            root_path: Optional root used to compute ``_rel_path`` values.

        Returns:
            Resolved destination path.

        Raises:
            KeyError: If ``groupby_column`` is unknown.
            ValueError: If grouping or relative-path validation fails.
            OSError: If writing fails.
        """
        from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

        return AcqImageListManifest(self).write_randomized_manifest_master_csv(
            csv_path,
            groupby_column=groupby_column,
            random_seed=random_seed,
            root_path=root_path,
        )

    def to_randomized_manifest_csv(
        self,
        csv_path: str | Path,
        *,
        master_csv_path: str | Path,
        n_per_group: int,
        allow_unbalanced: bool = False,
    ) -> Path:
        """Write a sampled randomized manifest from a master CSV.

        Args:
            csv_path: Destination CSV path.
            master_csv_path: Source randomized master CSV path.
            n_per_group: Number of rows to keep from each randomized group.
            allow_unbalanced: When false, every group must have at least
                ``n_per_group`` files.

        Returns:
            Resolved destination path.

        Raises:
            ValueError: If sampling validation fails.
            OSError: If the master CSV cannot be read or the output file cannot
                be written.
        """
        from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

        return AcqImageListManifest(self).write_randomized_manifest_csv(
            csv_path,
            master_csv_path=master_csv_path,
            n_per_group=n_per_group,
            allow_unbalanced=allow_unbalanced,
        )

    def _attach_analysis_pools(self) -> None:
        """Create collection-level analysis pools owned by this list."""
        from acqstore.analysis_pool.sum_intensity_analysis_pool import (
            SumIntensityAnalysisPool,
        )
        from acqstore.analysis_pool.velocity_analysis_pool import VelocityAnalysisPool

        self.velocity_analysis_pool = VelocityAnalysisPool(self)
        self.sum_intensity_analysis_pool = SumIntensityAnalysisPool(self)

    def __len__(self) -> int:
        """Return number of files in the collection."""
        return len(self._files)

    def __iter__(self) -> Iterator[AcqImage]:
        """Iterate files in stable display order."""
        return iter(self._files)

    def get_files(self) -> Sequence[AcqImage]:
        """Return files in stable display order."""
        return tuple(self._files)

    def get_file_by_id(self, file_id: str) -> AcqImage | None:
        """Return one file by stable identifier.

        Args:
            file_id: Stable file identifier.

        Returns:
            Matching file object, or ``None`` when not found.
        """
        return self._files_by_id.get(file_id)

    def get_file_by_index(self, index: int) -> AcqImage:
        """Return one file by stable display index.

        Args:
            index: Zero-based display index.

        Returns:
            Matching file object.

        Raises:
            IndexError: If the display index is out of range.
        """
        return self._files[index]

    def has_file_id(self, file_id: str) -> bool:
        """Return whether the file identifier exists in the collection."""
        return file_id in self._files_by_id

    def get_default_file_id(self) -> str | None:
        """Return the default file identifier in stable display order.

        Returns first file in list."""
        if not self._files:
            return None
        return self._files[0].file_id

    def get_default_selection(self) -> tuple[str | None, int | None, int | None]:
        """Return default primary selection for initial app state.

        Returns:
            Tuple of (file_id, channel, roi) using backend-native values.
            Any tuple member may be None when no explicit default exists.
        """
        default_file_id = self.get_default_file_id()
        if default_file_id is None:
            return (None, None, None)
        acq_file = self._files_by_id[default_file_id]
        return (
            default_file_id,
            acq_file.get_default_channel(),
            acq_file.get_default_roi(),
        )

    def get_dirty_files(self) -> Sequence[AcqImage]:
        """Return dirty files in stable display order."""
        return tuple(acq_file for acq_file in self._files if acq_file.is_dirty)

    def has_dirty_files(self) -> bool:
        """Return whether any file in the collection is dirty."""
        return any(acq_file.is_dirty for acq_file in self._files)

    def iter_save_all(
        self,
        *,
        should_cancel: Callable[[], bool] | None = None,
    ) -> Iterator[SaveProgress]:
        """Persist dirty files while yielding progress events.

        Args:
            should_cancel: Optional callback checked between file saves. Return
                True to stop iteration early.

        Yields:
            Save progress events for save start/finish and cancellation.
        """
        dirty_files = list(self.get_dirty_files())
        total = len(dirty_files)
        completed = 0

        for acq_file in dirty_files:
            if should_cancel is not None and should_cancel():
                yield SaveProgress(
                    event=SaveEvent.CANCELLED,
                    completed=completed,
                    total=total,
                    file_id=acq_file.file_id,
                )
                return

            yield SaveProgress(
                event=SaveEvent.SAVING,
                completed=completed,
                total=total,
                file_id=acq_file.file_id,
            )
            acq_file.save()
            completed += 1
            yield SaveProgress(
                event=SaveEvent.SAVED,
                completed=completed,
                total=total,
                file_id=acq_file.file_id,
            )

    def save_all(self, *, should_cancel: Callable[[], bool] | None = None) -> None:
        """Persist all dirty files in the collection.

        Args:
            should_cancel: Optional callback checked between file saves.
        """
        for _event in self.iter_save_all(should_cancel=should_cancel):
            continue

    def load_lazy_data(
        self,
        *,
        load_images: bool = True,
        load_analysis_csv: bool = True,
    ) -> None:
        """Load selected lazy data categories for every acquisition in the list.

        Args:
            load_images: Load primary image pixels when true.
            load_analysis_csv: Load analysis CSV result tables when true.
        """
        for acq_file in self._files:
            acq_file.load_lazy_data(
                load_images=load_images,
                load_analysis_csv=load_analysis_csv,
            )

    def unload_lazy_data(
        self,
        *,
        unload_images: bool = True,
        unload_analysis_csv: bool = True,
    ) -> None:
        """Unload selected lazy data categories for every acquisition in the list.

        Args:
            unload_images: Unload primary image pixels when true.
            unload_analysis_csv: Unload analysis CSV result tables when true.
        """
        for acq_file in self._files:
            acq_file.unload_lazy_data(
                unload_images=unload_images,
                unload_analysis_csv=unload_analysis_csv,
            )

    def get_unique_metadata_values(self, field_name: str) -> list[str]:
        """Return sorted unique non-empty values for one experiment metadata field.

        Values are collected from every loaded :class:`AcqImage` in this list.
        Only string fields declared by ``EXPERIMENT_METADATA_SCHEMA`` are
        supported.

        Args:
            field_name: Experiment metadata schema field name (e.g. ``species``).

        Returns:
            Sorted list of unique non-empty string values.

        Raises:
            ValueError: If ``field_name`` is unknown or not a string field.
        """
        fields_by_name = {field.name: field for field in EXPERIMENT_METADATA_SCHEMA.fields}
        if field_name not in fields_by_name:
            raise ValueError(f'Unknown experiment_metadata field: {field_name!r}')
        field_schema = fields_by_name[field_name]
        if field_schema.value_type is not ValueType.STR:
            raise ValueError(
                f'Field {field_name!r} is not a string field; '
                f'got value_type={field_schema.value_type!r}'
            )

        values: set[str] = set()
        section_id = ExperimentMetadata.metadata_section_id
        for acq_file in self._files:
            section = acq_file.get_metadata_section(section_id)
            raw = section.get_values().get(field_name)
            if raw is None:
                continue
            text = str(raw).strip()
            if text:
                values.add(text)
        return sorted(values)

    def get_schema(self) -> SchemaDefinition:
        """Return schema definition for rows in this list."""
        return ACQ_FILE_LIST_SCHEMA

    def get_schema_rows(self) -> list[dict[str, object]]:
        """Return schema-keyed rows for all files in stable display order.

        Returns:
            List of row dictionaries keyed by schema field name.

        Raises:
            KeyError: If a required schema field is missing from any row.
            ValueError: If any row has keys not declared by the schema.
        """
        schema = self.get_schema()
        rows = [acq_file.get_schema_row() for acq_file in self.get_files()]
        for row in rows:
            validate_values_for_schema(schema, row)
        return rows

    def get_tree_rows(self) -> list[dict[str, object]]:
        """Return tree rows for all files in stable display order.

        Returns:
            Flat row list containing each file row followed by its analysis
            child rows.
        """
        rows: list[dict[str, object]] = []
        for acq_file in self.get_files():
            rows.extend(acq_file.get_tree_rows())
        return rows

load_safe classmethod

load_safe(
    path: str,
    *,
    kind: PathKind | str,
    file_factory: Callable[[str], AcqImage] | None = None,
    folder_depth: int = 4,
    progress_callback: Callable[[int, int, str], None]
    | None = None,
    should_cancel: Callable[[], bool] | None = None,
    load_images: bool = True,
    load_analysis_csv: bool = True,
    root_path: str | Path | None = None,
) -> LoadResult

Load acquisition files while collecting non-fatal warnings.

This is the preferred loading API for GUI, notebook, and batch workflows that should keep usable files even when one file fails. Missing files, bad CSV rows, and individual loader errors are returned as :class:LoadWarning records. Cancellation is cooperative and checked between file loads.

Parameters:

Name Type Description Default
path str

Input path supplied by the user or caller.

required
kind PathKind | str

Explicit source kind (file, folder, or csv).

required
file_factory Callable[[str], AcqImage] | None

Optional file-construction callback for tests or dependency injection.

None
folder_depth int

Maximum folder traversal depth for folder loads.

4
progress_callback Callable[[int, int, str], None] | None

Optional callback called as progress_callback(completed, total, message) after discovery and after each attempted file load.

None
should_cancel Callable[[], bool] | None

Optional callback checked between file loads. Return True to cancel loading.

None
load_images bool

When true, default AcqImage construction eagerly loads primary pixels.

True
load_analysis_csv bool

When true, default AcqImage construction eagerly loads analysis CSV result tables.

True
root_path str | Path | None

Optional manifest root used for CSV loads. When omitted, CSV _rel_path values are resolved relative to the CSV parent.

None

Returns:

Type Description
LoadResult

class:LoadResult containing an AcqImageList and collected

LoadResult

warnings. The list may be empty.

Raises:

Type Description
LoadCancelled

If should_cancel requests cancellation.

Source code in src/acqstore/acq_image/acq_image_list.py
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
@classmethod
def load_safe(
    cls,
    path: str,
    *,
    kind: PathKind | str,
    file_factory: Callable[[str], AcqImage] | None = None,
    folder_depth: int = 4,
    progress_callback: Callable[[int, int, str], None] | None = None,
    should_cancel: Callable[[], bool] | None = None,
    load_images: bool = True,
    load_analysis_csv: bool = True,
    root_path: str | Path | None = None,
) -> LoadResult:
    """Load acquisition files while collecting non-fatal warnings.

    This is the preferred loading API for GUI, notebook, and batch workflows
    that should keep usable files even when one file fails. Missing files,
    bad CSV rows, and individual loader errors are returned as
    :class:`LoadWarning` records. Cancellation is cooperative and checked
    between file loads.

    Args:
        path: Input path supplied by the user or caller.
        kind: Explicit source kind (``file``, ``folder``, or ``csv``).
        file_factory: Optional file-construction callback for tests or
            dependency injection.
        folder_depth: Maximum folder traversal depth for folder loads.
        progress_callback: Optional callback called as
            ``progress_callback(completed, total, message)`` after discovery
            and after each attempted file load.
        should_cancel: Optional callback checked between file loads. Return
            ``True`` to cancel loading.
        load_images: When true, default ``AcqImage`` construction eagerly
            loads primary pixels.
        load_analysis_csv: When true, default ``AcqImage`` construction
            eagerly loads analysis CSV result tables.
        root_path: Optional manifest root used for CSV loads. When omitted,
            CSV ``_rel_path`` values are resolved relative to the CSV parent.

    Returns:
        :class:`LoadResult` containing an ``AcqImageList`` and collected
        warnings. The list may be empty.

    Raises:
        LoadCancelled: If ``should_cancel`` requests cancellation.
    """
    warnings: list[LoadWarning] = []
    path_obj = Path(path).expanduser()
    base_path = str(path_obj.resolve(strict=False))
    if isinstance(kind, str):
        try:
            kind = PathKind(kind)
        except ValueError:
            warnings.append(LoadWarning(message=f'Unsupported load kind: {kind}', path=base_path, error_type=LoadErrorType.CSV_ERROR))
            obj = cls.__new__(cls)
            obj.path = base_path
            obj.source_root_path = None
            obj.file_list = []
            obj._files = []
            obj._files_by_id = {}
            obj._attach_analysis_pools()
            return LoadResult(acq_image_list=obj, warnings=tuple(warnings), discovered_count=0)

    candidate_paths: list[str] = []
    if kind == PathKind.FOLDER:
        if not path_obj.exists() or not path_obj.is_dir():
            warnings.append(LoadWarning(message='Folder does not exist or is not a directory', path=base_path, error_type=LoadErrorType.MISSING_FILE))
        else:
            candidate_paths = _build_file_list(path_obj, get_allowed_import_extensions(), folder_depth=folder_depth)
    elif kind == PathKind.FILE:
        if not path_obj.exists() or not (path_obj.is_file() or path_has_allowed_import_extension(path_obj)):
            warnings.append(LoadWarning(message='File does not exist or is not a supported file/store', path=base_path, error_type=LoadErrorType.MISSING_FILE))
        else:
            candidate_paths = [str(path_obj.resolve())]
    elif kind == PathKind.CSV:
        csv_paths, csv_warnings = cls._build_file_list_from_csv_safe(path_obj, root_path=root_path)
        candidate_paths = csv_paths
        warnings.extend(csv_warnings)
    else:
        warnings.append(LoadWarning(message=f'Unsupported load kind: {kind}', path=base_path, error_type=LoadErrorType.CSV_ERROR))

    files: list[AcqImage] = []
    total = len(candidate_paths)
    if progress_callback is not None:
        progress_callback(0, total, f'Discovered {total} file(s)')
    for candidate in candidate_paths:
        if should_cancel is not None and should_cancel():
            raise LoadCancelled('Load cancelled')
        try:
            if file_factory is None:
                from acqstore.acq_image.acq_image import AcqImage

                built = AcqImage(
                    candidate,
                    load_images=load_images,
                    load_analysis_csv=load_analysis_csv,
                )
            else:
                built = file_factory(candidate)
            files.append(built)
        except Exception as exc:
            resolved_candidate = str(Path(candidate).resolve(strict=False))
            message = f'Failed to load file: {exc}'
            logger.error('%s: %s', message, resolved_candidate)
            warnings.append(LoadWarning(message=message, path=resolved_candidate, error_type=LoadErrorType.LOADER_ERROR, resolved_path=resolved_candidate))
        if progress_callback is not None:
            progress_callback(len(files), total, f'Loaded {len(files)}/{total}')

    obj = cls.__new__(cls)
    obj.path = base_path
    if kind == PathKind.FOLDER:
        obj.source_root_path = str(path_obj.resolve(strict=False))
    elif kind == PathKind.CSV:
        csv_root = Path(root_path).expanduser() if root_path is not None else path_obj.parent
        obj.source_root_path = str(csv_root.resolve(strict=False))
    elif kind == PathKind.FILE:
        obj.source_root_path = str(path_obj.resolve(strict=False).parent)
    else:
        obj.source_root_path = None
    obj.file_list = [str(Path(file.path).resolve(strict=False)) if hasattr(file, 'path') else file.file_id for file in files]
    obj._files = files
    obj._files_by_id = {acq_file.file_id: acq_file for acq_file in files}
    obj._attach_analysis_pools()
    return LoadResult(acq_image_list=obj, warnings=tuple(warnings), discovered_count=total)

from_manifest_csv classmethod

from_manifest_csv(
    csv_path: str | Path,
    *,
    root_path: str | Path | None = None,
    file_factory: Callable[[str], AcqImage] | None = None,
    load_images: bool = True,
    load_analysis_csv: bool = True,
) -> LoadResult

Safely load an acquisition list from a manifest CSV.

Parameters:

Name Type Description Default
csv_path str | Path

CSV file containing a required _rel_path column.

required
root_path str | Path | None

Optional manifest root. When omitted, paths are resolved relative to the CSV parent directory.

None
file_factory Callable[[str], AcqImage] | None

Optional file-construction callback for tests or dependency injection.

None
load_images bool

When true, default AcqImage construction eagerly loads primary pixels.

True
load_analysis_csv bool

When true, default AcqImage construction eagerly loads analysis CSV result tables.

True

Returns:

Type Description
LoadResult

Structured load result containing the loaded list and warnings.

Raises:

Type Description
LoadCancelled

Never raised by this wrapper because no cancellation callback is accepted.

Source code in src/acqstore/acq_image/acq_image_list.py
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
@classmethod
def from_manifest_csv(
    cls,
    csv_path: str | Path,
    *,
    root_path: str | Path | None = None,
    file_factory: Callable[[str], AcqImage] | None = None,
    load_images: bool = True,
    load_analysis_csv: bool = True,
) -> LoadResult:
    """Safely load an acquisition list from a manifest CSV.

    Args:
        csv_path: CSV file containing a required ``_rel_path`` column.
        root_path: Optional manifest root. When omitted, paths are resolved
            relative to the CSV parent directory.
        file_factory: Optional file-construction callback for tests or
            dependency injection.
        load_images: When true, default ``AcqImage`` construction eagerly
            loads primary pixels.
        load_analysis_csv: When true, default ``AcqImage`` construction
            eagerly loads analysis CSV result tables.

    Returns:
        Structured load result containing the loaded list and warnings.

    Raises:
        LoadCancelled: Never raised by this wrapper because no cancellation
            callback is accepted.
    """
    return cls.load_safe(
        str(csv_path),
        kind=PathKind.CSV,
        file_factory=file_factory,
        load_images=load_images,
        load_analysis_csv=load_analysis_csv,
        root_path=root_path,
    )

to_manifest_csv

to_manifest_csv(
    csv_path: str | Path,
    *,
    root_path: str | Path | None = None,
) -> Path

Write all files in this list to a manifest CSV.

Parameters:

Name Type Description Default
csv_path str | Path

Destination CSV path.

required
root_path str | Path | None

Optional root used to compute _rel_path values.

None

Returns:

Type Description
Path

Resolved destination path.

Raises:

Type Description
ValueError

If a file path cannot be represented relative to the effective root.

OSError

If writing fails.

Source code in src/acqstore/acq_image/acq_image_list.py
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
def to_manifest_csv(
    self,
    csv_path: str | Path,
    *,
    root_path: str | Path | None = None,
) -> Path:
    """Write all files in this list to a manifest CSV.

    Args:
        csv_path: Destination CSV path.
        root_path: Optional root used to compute ``_rel_path`` values.

    Returns:
        Resolved destination path.

    Raises:
        ValueError: If a file path cannot be represented relative to the
            effective root.
        OSError: If writing fails.
    """
    from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

    return AcqImageListManifest(self).write_manifest_csv(csv_path, root_path=root_path)

to_randomized_manifest_master_csv

to_randomized_manifest_master_csv(
    csv_path: str | Path,
    *,
    groupby_column: str,
    random_seed: int | None = None,
    root_path: str | Path | None = None,
) -> Path

Write the full deterministic randomized manifest for this list.

Parameters:

Name Type Description Default
csv_path str | Path

Destination CSV path.

required
groupby_column str

Schema row column used to define groups.

required
random_seed int | None

Optional seed for deterministic shuffling.

None
root_path str | Path | None

Optional root used to compute _rel_path values.

None

Returns:

Type Description
Path

Resolved destination path.

Raises:

Type Description
KeyError

If groupby_column is unknown.

ValueError

If grouping or relative-path validation fails.

OSError

If writing fails.

Source code in src/acqstore/acq_image/acq_image_list.py
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
def to_randomized_manifest_master_csv(
    self,
    csv_path: str | Path,
    *,
    groupby_column: str,
    random_seed: int | None = None,
    root_path: str | Path | None = None,
) -> Path:
    """Write the full deterministic randomized manifest for this list.

    Args:
        csv_path: Destination CSV path.
        groupby_column: Schema row column used to define groups.
        random_seed: Optional seed for deterministic shuffling.
        root_path: Optional root used to compute ``_rel_path`` values.

    Returns:
        Resolved destination path.

    Raises:
        KeyError: If ``groupby_column`` is unknown.
        ValueError: If grouping or relative-path validation fails.
        OSError: If writing fails.
    """
    from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

    return AcqImageListManifest(self).write_randomized_manifest_master_csv(
        csv_path,
        groupby_column=groupby_column,
        random_seed=random_seed,
        root_path=root_path,
    )

to_randomized_manifest_csv

to_randomized_manifest_csv(
    csv_path: str | Path,
    *,
    master_csv_path: str | Path,
    n_per_group: int,
    allow_unbalanced: bool = False,
) -> Path

Write a sampled randomized manifest from a master CSV.

Parameters:

Name Type Description Default
csv_path str | Path

Destination CSV path.

required
master_csv_path str | Path

Source randomized master CSV path.

required
n_per_group int

Number of rows to keep from each randomized group.

required
allow_unbalanced bool

When false, every group must have at least n_per_group files.

False

Returns:

Type Description
Path

Resolved destination path.

Raises:

Type Description
ValueError

If sampling validation fails.

OSError

If the master CSV cannot be read or the output file cannot be written.

Source code in src/acqstore/acq_image/acq_image_list.py
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
def to_randomized_manifest_csv(
    self,
    csv_path: str | Path,
    *,
    master_csv_path: str | Path,
    n_per_group: int,
    allow_unbalanced: bool = False,
) -> Path:
    """Write a sampled randomized manifest from a master CSV.

    Args:
        csv_path: Destination CSV path.
        master_csv_path: Source randomized master CSV path.
        n_per_group: Number of rows to keep from each randomized group.
        allow_unbalanced: When false, every group must have at least
            ``n_per_group`` files.

    Returns:
        Resolved destination path.

    Raises:
        ValueError: If sampling validation fails.
        OSError: If the master CSV cannot be read or the output file cannot
            be written.
    """
    from acqstore.acq_image.acq_image_manifest import AcqImageListManifest

    return AcqImageListManifest(self).write_randomized_manifest_csv(
        csv_path,
        master_csv_path=master_csv_path,
        n_per_group=n_per_group,
        allow_unbalanced=allow_unbalanced,
    )

get_files

get_files() -> Sequence[AcqImage]

Return files in stable display order.

Source code in src/acqstore/acq_image/acq_image_list.py
742
743
744
def get_files(self) -> Sequence[AcqImage]:
    """Return files in stable display order."""
    return tuple(self._files)

get_file_by_id

get_file_by_id(file_id: str) -> AcqImage | None

Return one file by stable identifier.

Parameters:

Name Type Description Default
file_id str

Stable file identifier.

required

Returns:

Type Description
AcqImage | None

Matching file object, or None when not found.

Source code in src/acqstore/acq_image/acq_image_list.py
746
747
748
749
750
751
752
753
754
755
def get_file_by_id(self, file_id: str) -> AcqImage | None:
    """Return one file by stable identifier.

    Args:
        file_id: Stable file identifier.

    Returns:
        Matching file object, or ``None`` when not found.
    """
    return self._files_by_id.get(file_id)

get_file_by_index

get_file_by_index(index: int) -> AcqImage

Return one file by stable display index.

Parameters:

Name Type Description Default
index int

Zero-based display index.

required

Returns:

Type Description
AcqImage

Matching file object.

Raises:

Type Description
IndexError

If the display index is out of range.

Source code in src/acqstore/acq_image/acq_image_list.py
757
758
759
760
761
762
763
764
765
766
767
768
769
def get_file_by_index(self, index: int) -> AcqImage:
    """Return one file by stable display index.

    Args:
        index: Zero-based display index.

    Returns:
        Matching file object.

    Raises:
        IndexError: If the display index is out of range.
    """
    return self._files[index]

has_file_id

has_file_id(file_id: str) -> bool

Return whether the file identifier exists in the collection.

Source code in src/acqstore/acq_image/acq_image_list.py
771
772
773
def has_file_id(self, file_id: str) -> bool:
    """Return whether the file identifier exists in the collection."""
    return file_id in self._files_by_id

get_default_file_id

get_default_file_id() -> str | None

Return the default file identifier in stable display order.

Returns first file in list.

Source code in src/acqstore/acq_image/acq_image_list.py
775
776
777
778
779
780
781
def get_default_file_id(self) -> str | None:
    """Return the default file identifier in stable display order.

    Returns first file in list."""
    if not self._files:
        return None
    return self._files[0].file_id

get_default_selection

get_default_selection() -> tuple[
    str | None, int | None, int | None
]

Return default primary selection for initial app state.

Returns:

Type Description
str | None

Tuple of (file_id, channel, roi) using backend-native values.

int | None

Any tuple member may be None when no explicit default exists.

Source code in src/acqstore/acq_image/acq_image_list.py
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
def get_default_selection(self) -> tuple[str | None, int | None, int | None]:
    """Return default primary selection for initial app state.

    Returns:
        Tuple of (file_id, channel, roi) using backend-native values.
        Any tuple member may be None when no explicit default exists.
    """
    default_file_id = self.get_default_file_id()
    if default_file_id is None:
        return (None, None, None)
    acq_file = self._files_by_id[default_file_id]
    return (
        default_file_id,
        acq_file.get_default_channel(),
        acq_file.get_default_roi(),
    )

get_dirty_files

get_dirty_files() -> Sequence[AcqImage]

Return dirty files in stable display order.

Source code in src/acqstore/acq_image/acq_image_list.py
800
801
802
def get_dirty_files(self) -> Sequence[AcqImage]:
    """Return dirty files in stable display order."""
    return tuple(acq_file for acq_file in self._files if acq_file.is_dirty)

has_dirty_files

has_dirty_files() -> bool

Return whether any file in the collection is dirty.

Source code in src/acqstore/acq_image/acq_image_list.py
804
805
806
def has_dirty_files(self) -> bool:
    """Return whether any file in the collection is dirty."""
    return any(acq_file.is_dirty for acq_file in self._files)

iter_save_all

iter_save_all(
    *, should_cancel: Callable[[], bool] | None = None
) -> Iterator[SaveProgress]

Persist dirty files while yielding progress events.

Parameters:

Name Type Description Default
should_cancel Callable[[], bool] | None

Optional callback checked between file saves. Return True to stop iteration early.

None

Yields:

Type Description
SaveProgress

Save progress events for save start/finish and cancellation.

Source code in src/acqstore/acq_image/acq_image_list.py
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
def iter_save_all(
    self,
    *,
    should_cancel: Callable[[], bool] | None = None,
) -> Iterator[SaveProgress]:
    """Persist dirty files while yielding progress events.

    Args:
        should_cancel: Optional callback checked between file saves. Return
            True to stop iteration early.

    Yields:
        Save progress events for save start/finish and cancellation.
    """
    dirty_files = list(self.get_dirty_files())
    total = len(dirty_files)
    completed = 0

    for acq_file in dirty_files:
        if should_cancel is not None and should_cancel():
            yield SaveProgress(
                event=SaveEvent.CANCELLED,
                completed=completed,
                total=total,
                file_id=acq_file.file_id,
            )
            return

        yield SaveProgress(
            event=SaveEvent.SAVING,
            completed=completed,
            total=total,
            file_id=acq_file.file_id,
        )
        acq_file.save()
        completed += 1
        yield SaveProgress(
            event=SaveEvent.SAVED,
            completed=completed,
            total=total,
            file_id=acq_file.file_id,
        )

save_all

save_all(
    *, should_cancel: Callable[[], bool] | None = None
) -> None

Persist all dirty files in the collection.

Parameters:

Name Type Description Default
should_cancel Callable[[], bool] | None

Optional callback checked between file saves.

None
Source code in src/acqstore/acq_image/acq_image_list.py
851
852
853
854
855
856
857
858
def save_all(self, *, should_cancel: Callable[[], bool] | None = None) -> None:
    """Persist all dirty files in the collection.

    Args:
        should_cancel: Optional callback checked between file saves.
    """
    for _event in self.iter_save_all(should_cancel=should_cancel):
        continue

load_lazy_data

load_lazy_data(
    *,
    load_images: bool = True,
    load_analysis_csv: bool = True,
) -> None

Load selected lazy data categories for every acquisition in the list.

Parameters:

Name Type Description Default
load_images bool

Load primary image pixels when true.

True
load_analysis_csv bool

Load analysis CSV result tables when true.

True
Source code in src/acqstore/acq_image/acq_image_list.py
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
def load_lazy_data(
    self,
    *,
    load_images: bool = True,
    load_analysis_csv: bool = True,
) -> None:
    """Load selected lazy data categories for every acquisition in the list.

    Args:
        load_images: Load primary image pixels when true.
        load_analysis_csv: Load analysis CSV result tables when true.
    """
    for acq_file in self._files:
        acq_file.load_lazy_data(
            load_images=load_images,
            load_analysis_csv=load_analysis_csv,
        )

unload_lazy_data

unload_lazy_data(
    *,
    unload_images: bool = True,
    unload_analysis_csv: bool = True,
) -> None

Unload selected lazy data categories for every acquisition in the list.

Parameters:

Name Type Description Default
unload_images bool

Unload primary image pixels when true.

True
unload_analysis_csv bool

Unload analysis CSV result tables when true.

True
Source code in src/acqstore/acq_image/acq_image_list.py
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
def unload_lazy_data(
    self,
    *,
    unload_images: bool = True,
    unload_analysis_csv: bool = True,
) -> None:
    """Unload selected lazy data categories for every acquisition in the list.

    Args:
        unload_images: Unload primary image pixels when true.
        unload_analysis_csv: Unload analysis CSV result tables when true.
    """
    for acq_file in self._files:
        acq_file.unload_lazy_data(
            unload_images=unload_images,
            unload_analysis_csv=unload_analysis_csv,
        )

get_unique_metadata_values

get_unique_metadata_values(field_name: str) -> list[str]

Return sorted unique non-empty values for one experiment metadata field.

Values are collected from every loaded :class:AcqImage in this list. Only string fields declared by EXPERIMENT_METADATA_SCHEMA are supported.

Parameters:

Name Type Description Default
field_name str

Experiment metadata schema field name (e.g. species).

required

Returns:

Type Description
list[str]

Sorted list of unique non-empty string values.

Raises:

Type Description
ValueError

If field_name is unknown or not a string field.

Source code in src/acqstore/acq_image/acq_image_list.py
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
def get_unique_metadata_values(self, field_name: str) -> list[str]:
    """Return sorted unique non-empty values for one experiment metadata field.

    Values are collected from every loaded :class:`AcqImage` in this list.
    Only string fields declared by ``EXPERIMENT_METADATA_SCHEMA`` are
    supported.

    Args:
        field_name: Experiment metadata schema field name (e.g. ``species``).

    Returns:
        Sorted list of unique non-empty string values.

    Raises:
        ValueError: If ``field_name`` is unknown or not a string field.
    """
    fields_by_name = {field.name: field for field in EXPERIMENT_METADATA_SCHEMA.fields}
    if field_name not in fields_by_name:
        raise ValueError(f'Unknown experiment_metadata field: {field_name!r}')
    field_schema = fields_by_name[field_name]
    if field_schema.value_type is not ValueType.STR:
        raise ValueError(
            f'Field {field_name!r} is not a string field; '
            f'got value_type={field_schema.value_type!r}'
        )

    values: set[str] = set()
    section_id = ExperimentMetadata.metadata_section_id
    for acq_file in self._files:
        section = acq_file.get_metadata_section(section_id)
        raw = section.get_values().get(field_name)
        if raw is None:
            continue
        text = str(raw).strip()
        if text:
            values.add(text)
    return sorted(values)

get_schema

get_schema() -> SchemaDefinition

Return schema definition for rows in this list.

Source code in src/acqstore/acq_image/acq_image_list.py
934
935
936
def get_schema(self) -> SchemaDefinition:
    """Return schema definition for rows in this list."""
    return ACQ_FILE_LIST_SCHEMA

get_schema_rows

get_schema_rows() -> list[dict[str, object]]

Return schema-keyed rows for all files in stable display order.

Returns:

Type Description
list[dict[str, object]]

List of row dictionaries keyed by schema field name.

Raises:

Type Description
KeyError

If a required schema field is missing from any row.

ValueError

If any row has keys not declared by the schema.

Source code in src/acqstore/acq_image/acq_image_list.py
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
def get_schema_rows(self) -> list[dict[str, object]]:
    """Return schema-keyed rows for all files in stable display order.

    Returns:
        List of row dictionaries keyed by schema field name.

    Raises:
        KeyError: If a required schema field is missing from any row.
        ValueError: If any row has keys not declared by the schema.
    """
    schema = self.get_schema()
    rows = [acq_file.get_schema_row() for acq_file in self.get_files()]
    for row in rows:
        validate_values_for_schema(schema, row)
    return rows

get_tree_rows

get_tree_rows() -> list[dict[str, object]]

Return tree rows for all files in stable display order.

Returns:

Type Description
list[dict[str, object]]

Flat row list containing each file row followed by its analysis

list[dict[str, object]]

child rows.

Source code in src/acqstore/acq_image/acq_image_list.py
954
955
956
957
958
959
960
961
962
963
964
def get_tree_rows(self) -> list[dict[str, object]]:
    """Return tree rows for all files in stable display order.

    Returns:
        Flat row list containing each file row followed by its analysis
        child rows.
    """
    rows: list[dict[str, object]] = []
    for acq_file in self.get_files():
        rows.extend(acq_file.get_tree_rows())
    return rows