Skip to content

sam-2 compatiblity error for replace mode #157

Description

@ishaangupta-YB
video frame: 100%|████████████████████████████████████████████████████████████████████████| 205/205 [00:04<00:00, 47.13it/s]
Traceback (most recent call last):
  File "/root/Wan-Animate/Wan2.2/wan/modules/animate/preprocess/preprocess_data.py", line 109, in <module>
    process_pipeline(video_path=args.video_path,
  File "/root/Wan-Animate/Wan2.2/wan/modules/animate/preprocess/process_pipepline.py", line 97, in call
    masks = self.get_mask(frames, 400, tpl_pose_metas)
  File "/root/Wan-Animate/Wan2.2/wan/modules/animate/preprocess/process_pipepline.py", line 319, in get_mask
    self.predictor.reset_state(inference_state)
  File "/root/Wan-Animate/.venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, kwargs)
  File "/root/Wan-Animate/segment-anything-2/sam2/sam2_video_predictor.py", line 678, in reset_state
    self._reset_tracking_results(inference_state)
  File "/root/Wan-Animate/segment-anything-2/sam2/sam2_video_predictor.py", line 701, in resettracking_results
    for v in inference_state["frames_tracked_per_obj"].values():
KeyError: 'frames_tracked_per_obj'

stuck at above error when running command for replacement mode -

python wan/modules/animate/preprocess/preprocess_data.py
--ckpt_path Wan2.2-Animate-14B/process_checkpoint
--video_path examples/wan_animate/replace/video.mp4
--refer_path examples/wan_animate/replace/image.jpeg
--save_path examples/wan_animate/replace/process_results
--resolution_area 1280 720
--iterations 3
--k 7
--w_len 1
--h_len 1
--replace_flag

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions