How find and delete double files?

Ralf1958Ralf1958 Posts: 688
edited December 1969 in The Commons

I am wondering about how to find and delete doubles of files. I have two databases located in two different Folders. This is happened because of a new installation, so in order to Keep the new Database clean, I just saved all the old data in another Folder. Some Products are now appearing twice. By example Michael 6 appears in Folder 1 and as well in Folder 2. Is there a way to erase all the files that belong to Michael 6 from Folder 2? This is just an Example, I have many different products in both databases. I want to Keep those two databases separated. One for all the DAZ Products and the other one for Stuff from Renderosity and other provenience. Basically what I want to do, is to erase all the DAZ Products from Folder 2. Any idea? Thank you!

Comments

  • HavosHavos Posts: 5,439
    edited December 1969

    ralf said:
    I am wondering about how to find and delete doubles of files. I have two databases located in two different Folders. This is happened because of a new installation, so in order to Keep the new Database clean, I just saved all the old data in another Folder. Some Products are now appearing twice. By example Michael 6 appears in Folder 1 and as well in Folder 2. Is there a way to erase all the files that belong to Michael 6 from Folder 2? This is just an Example, I have many different products in both databases. I want to Keep those two databases separated. One for all the DAZ Products and the other one for Stuff from Renderosity and other provenience. Basically what I want to do, is to erase all the DAZ Products from Folder 2. Any idea? Thank you!

    I would recommend you look at clonespy, it is free and highlights all duplicates files. You can select an option to move the duplicates, rather than just deleting them, that way you can see what it found, and you can review the effect. Link is

    http://www.clonespy.com/

    Of course on a runtime you have to be careful what you have removed, so if a particular product has been installed in two locations you need to be careful which one is being used by smart content. Probably best to purge from one runtime only, and then reimport the meta data

  • Ralf1958Ralf1958 Posts: 688
    edited December 1969

    Thank you Havos! Well, I am sure the Smart Database uses all the Data from Folder 1. I added Folder 2 later on. My Major concern is actually the runtime. I am afraid of deleting the wrong stuff. I already tryed a couple of programs that find doubles, but somehow None of them gave me the possibility of deleting all the double files in a specific Folder. I would have to spend hours in selecting every file manually and that's to time consuming, they are thousends!!! I will give a look at the program you suggested, maybe that will help me out. :-)

  • HavosHavos Posts: 5,439
    edited December 1969

    ralf said:
    Thank you Havos! Well, I am sure the Smart Database uses all the Data from Folder 1. I added Folder 2 later on. My Major concern is actually the runtime. I am afraid of deleting the wrong stuff. I already tryed a couple of programs that find doubles, but somehow None of them gave me the possibility of deleting all the double files in a specific Folder. I would have to spend hours in selecting every file manually and that's to time consuming, they are thousends!!! I will give a look at the program you suggested, maybe that will help me out. :-)

    With clonespy you can select the folder to delete from, but in addition I would go into the settings and select the option to move the deleted files to a folder first, that way you can see what happened. This is particularly useful to see if only part of a folder had contents removed, as it suggests the rest of the folder is similar to something else. Remember that some files may be duplicated between different products, and in these cases the duplicate should remain (eg imagine some of the material jpgs of one character being the same, but with different names, as another character)

  • fixmypcmikefixmypcmike Posts: 19,619
    edited December 1969

    Clonespy is excellent, but for DS/Poser content I use http://www.daz3d.com/content-folder-twins as it has the ability to match only if relative path is the same, which Clonespy unfortunately does not.

  • Ralf1958Ralf1958 Posts: 688
    edited December 1969

    Clonespy is excellent, but for DS/Poser content I use http://www.daz3d.com/content-folder-twins as it has the ability to match only if relative path is the same, which Clonespy unfortunately does not.

    I just bought Content Folder twins. Well... I am figuring it out... but so far I can see it doesn't give me an Option to automatically delete all the duplicate Folders. I have to delete every single file manually. That's going to be a lot of work... It has found something about 100.000 duplicate files! :-(

  • Ralf1958Ralf1958 Posts: 688
    edited December 1969

    Havos said:
    ralf said:
    Thank you Havos! Well, I am sure the Smart Database uses all the Data from Folder 1. I added Folder 2 later on. My Major concern is actually the runtime. I am afraid of deleting the wrong stuff. I already tryed a couple of programs that find doubles, but somehow None of them gave me the possibility of deleting all the double files in a specific Folder. I would have to spend hours in selecting every file manually and that's to time consuming, they are thousends!!! I will give a look at the program you suggested, maybe that will help me out. :-)

    With clonespy you can select the folder to delete from, but in addition I would go into the settings and select the option to move the deleted files to a folder first, that way you can see what happened. This is particularly useful to see if only part of a folder had contents removed, as it suggests the rest of the folder is similar to something else. Remember that some files may be duplicated between different products, and in these cases the duplicate should remain (eg imagine some of the material jpgs of one character being the same, but with different names, as another character)

    Clonespy didn't help me out either... if I want the Option to delete entire Folders, I Need to buy the PRO Version.

  • fixmypcmikefixmypcmike Posts: 19,619
    edited December 1969

    ralf said:
    Clonespy is excellent, but for DS/Poser content I use http://www.daz3d.com/content-folder-twins as it has the ability to match only if relative path is the same, which Clonespy unfortunately does not.

    I just bought Content Folder twins. Well... I am figuring it out... but so far I can see it doesn't give me an Option to automatically delete all the duplicate Folders. I have to delete every single file manually. That's going to be a lot of work... It has found something about 100.000 duplicate files! :-(

    You don't have the latest version? You can set the priority for your content folders, select all, right-click and choose "Delete all except one", and it will keep only the highest-priority copy. Make sure you have it matching based on Relative Path.

  • HavosHavos Posts: 5,439
    edited December 1969

    ralf said:
    Havos said:
    ralf said:
    Thank you Havos! Well, I am sure the Smart Database uses all the Data from Folder 1. I added Folder 2 later on. My Major concern is actually the runtime. I am afraid of deleting the wrong stuff. I already tryed a couple of programs that find doubles, but somehow None of them gave me the possibility of deleting all the double files in a specific Folder. I would have to spend hours in selecting every file manually and that's to time consuming, they are thousends!!! I will give a look at the program you suggested, maybe that will help me out. :-)

    With clonespy you can select the folder to delete from, but in addition I would go into the settings and select the option to move the deleted files to a folder first, that way you can see what happened. This is particularly useful to see if only part of a folder had contents removed, as it suggests the rest of the folder is similar to something else. Remember that some files may be duplicated between different products, and in these cases the duplicate should remain (eg imagine some of the material jpgs of one character being the same, but with different names, as another character)

    Clonespy didn't help me out either... if I want the Option to delete entire Folders, I Need to buy the PRO Version.

    Now I am confused, I did not even know there was a PRO version, there is no mention of it on their website. I have the free version and you can delete everything, including folders with it.

    Anyway, it looks like Mike has found you a more suitable solution.

  • Ralf1958Ralf1958 Posts: 688
    edited December 1969

    Yes, indeed. I just had to rename the Folders, to get them in the proper order. Now I got all the DAZ Content in one Database and all the other stuff in the other one. Thanks for your help guys. I had to erase about 29.000 files and 4000 empty Folders. Everything is the way I wanted it. Thanks again! :-)

Sign In or Register to comment.