F5F Stay Refreshed Software General Software Searching for duplicate files or images that occur consecutively.

Searching for duplicate files or images that occur consecutively.

Searching for duplicate files or images that occur consecutively.

Pages (2): 1 2 Next
G
ghostlyplayer_
Junior Member
11
01-05-2016, 05:15 PM
#1
if the first 1-5 files match, it should remove 2-5, then start with file 6 and check for further duplicates... but if file 100 is a duplicate of file 1, I shouldn't delete it, only files like 101, 102, 103 if they match file 100 (which would also match file 1). Is there any software that can handle this? If it becomes easier, it should be able to work with hashes rather than relying on visual similarity. I was considering creating a batch file to automate this using matching hashes.
G
ghostlyplayer_
01-05-2016, 05:15 PM #1

if the first 1-5 files match, it should remove 2-5, then start with file 6 and check for further duplicates... but if file 100 is a duplicate of file 1, I shouldn't delete it, only files like 101, 102, 103 if they match file 100 (which would also match file 1). Is there any software that can handle this? If it becomes easier, it should be able to work with hashes rather than relying on visual similarity. I was considering creating a batch file to automate this using matching hashes.

W
Windlander
Member
150
01-05-2016, 07:13 PM
#2
These are types of image files. Be mindful that certain formats may contain EXIF or other metadata, which can cause differences even when images appear identical visually. The operating system used is not specified here. Regarding the naming, yes, the files are often given names in a sequence that increases predictably, especially if you're building a script.
W
Windlander
01-05-2016, 07:13 PM #2

These are types of image files. Be mindful that certain formats may contain EXIF or other metadata, which can cause differences even when images appear identical visually. The operating system used is not specified here. Regarding the naming, yes, the files are often given names in a sequence that increases predictably, especially if you're building a script.

D
DarkTiger427
Member
186
01-05-2016, 07:55 PM
#3
I used a hashing app to check that their hashes aligned. It worked with Windows too. I managed to figure it out eventually—besides the first 19 files, every 20 files matched, making it simple to filter them out. Still, I’d like to know how to do this again for future situations where it might be trickier. The files had names that increased sequentially.
D
DarkTiger427
01-05-2016, 07:55 PM #3

I used a hashing app to check that their hashes aligned. It worked with Windows too. I managed to figure it out eventually—besides the first 19 files, every 20 files matched, making it simple to filter them out. Still, I’d like to know how to do this again for future situations where it might be trickier. The files had names that increased sequentially.

X
xFyUZx
Member
158
01-07-2016, 07:38 AM
#4
And I will inquire about the source of the image duplications—whether it stems from software, procedural issues, or human mistakes.
Identify if there are methods to stop or reduce these repetitions.
Uncertain about the controls that might affect the animation process.
A quick thought here.
X
xFyUZx
01-07-2016, 07:38 AM #4

And I will inquire about the source of the image duplications—whether it stems from software, procedural issues, or human mistakes.
Identify if there are methods to stop or reduce these repetitions.
Uncertain about the controls that might affect the animation process.
A quick thought here.

X
xMrR3AP3RZx
Junior Member
40
01-28-2016, 08:05 AM
#5
Bitmaps refers to a collection of various file types, encompassing formats such as bmp, jpg, tiff, webp, among others, whereas image formats like svg, emf, dxf do not accurately represent bitmap images.
X
xMrR3AP3RZx
01-28-2016, 08:05 AM #5

Bitmaps refers to a collection of various file types, encompassing formats such as bmp, jpg, tiff, webp, among others, whereas image formats like svg, emf, dxf do not accurately represent bitmap images.

I
ImC000L
Junior Member
42
01-29-2016, 12:55 PM
#6
They are the frames taken from the animation.
It's clear that people won't mention a PNG or JPG when they talk about a "bitmap file" unless they're being very technical about image storage methods instead of explaining what kind of image file you're referring to. If you really need it, they are BMP format.
I
ImC000L
01-29-2016, 12:55 PM #6

They are the frames taken from the animation.
It's clear that people won't mention a PNG or JPG when they talk about a "bitmap file" unless they're being very technical about image storage methods instead of explaining what kind of image file you're referring to. If you really need it, they are BMP format.

U
UtahRaptor02
Junior Member
10
01-29-2016, 01:04 PM
#7
Extracted frames here...
I’m not a graphics expert, producer, etc., so I can only speculate about what these frames are for and why they’re being taken.
In general, I’d assume there’s an editorial reason behind this extraction.
Yet, it’s also possible that such steps aren’t always required, which would mean the process is turned off or bypassed.
It’s worth noting the file type matters if we aim to detect and eliminate duplicates.
Clearing duplicates can be handled by various file management tools, utilities, or even PowerShell scripts.
Thus, there are two clear options: 1) stop duplications from forming, and 2) apply file management techniques to locate and remove them.
U
UtahRaptor02
01-29-2016, 01:04 PM #7

Extracted frames here...
I’m not a graphics expert, producer, etc., so I can only speculate about what these frames are for and why they’re being taken.
In general, I’d assume there’s an editorial reason behind this extraction.
Yet, it’s also possible that such steps aren’t always required, which would mean the process is turned off or bypassed.
It’s worth noting the file type matters if we aim to detect and eliminate duplicates.
Clearing duplicates can be handled by various file management tools, utilities, or even PowerShell scripts.
Thus, there are two clear options: 1) stop duplications from forming, and 2) apply file management techniques to locate and remove them.

A
alllymiller10
Junior Member
14
02-05-2016, 07:22 PM
#8
You're likely correct. It would be clearer to specify the BMP file type along with its resolution and color space. Regarding the term "identical," you should compare the frames to identify any pixels that differ slightly, such as by using an image editor like Gimp, layering the images, and applying a "different" blend option before merging, followed by a gamma adjustment to highlight those differences.
A
alllymiller10
02-05-2016, 07:22 PM #8

You're likely correct. It would be clearer to specify the BMP file type along with its resolution and color space. Regarding the term "identical," you should compare the frames to identify any pixels that differ slightly, such as by using an image editor like Gimp, layering the images, and applying a "different" blend option before merging, followed by a gamma adjustment to highlight those differences.

O
OwnerOfHive
Member
105
02-07-2016, 03:21 AM
#9
I wonder about this.
In a video, a single pixel change might seem identical.
But to the human eye, it could differ.
For software, it might not be noticeable.
O
OwnerOfHive
02-07-2016, 03:21 AM #9

I wonder about this.
In a video, a single pixel change might seem identical.
But to the human eye, it could differ.
For software, it might not be noticeable.

P
PolrBoyQG
Junior Member
8
02-07-2016, 04:08 AM
#10
I noticed that the frames with similar appearances shared identical hashes. This led me to believe they were likely the same image, because any variation in a single pixel would result in a completely different hash, right?
P
PolrBoyQG
02-07-2016, 04:08 AM #10

I noticed that the frames with similar appearances shared identical hashes. This led me to believe they were likely the same image, because any variation in a single pixel would result in a completely different hash, right?

Pages (2): 1 2 Next