Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[agracier]

On a whim I opened up the wrapper.log file and took a look inside. This was in my last one:

Scanning #DBW folder took 156 milliseconds.
Total number of modded files = 20700.
Sorting modded files list took 7.499 milliseconds.
Removing 340 Duplicates took 1.067 milliseconds.
Total files opened = 204753
Total search time consumed = 14.751 milliseconds (0.014750674367 Seconds)
Search Time per File = 72.041 nanoseconds (0.000000072041 Seconds)
Average Search Iterations required per File = 8.5

Sounds all straightforward and obvious to me. I was however intrigue about the removing duplicates message. I guess 340 duplicates out of 20700 files isn't that much, but still.

Do these duplicates have any effect on the game or the possibilities of adding more mods?

I'm mainly curious and also always looking for the edge ...

[Birdman]

It is the Wrapper that removes those dublicates, so your IL-2 and its Java engine only sees one version of each file, the one that is earliest in the alphabetical order of mod folders in your #DBW folder. Thus, duplicate files only slow down startup a bit but shouldn't affect performance, Java memory limit or anything else after your IL-2 starts.

However, the content of the loaded file does matter. Some of those dublicates may be caused by some mod conflicts while others are meant to be there in the structure of DBW. For example, AI mod includes four duplicate classfiles that load instead of base DBW classfiles in XTD folder, and that is meant to be so to apply necessary AI modifications. However, if you have some mods installed with dublicate classfiles that are not DBW compatible, then you may have some features of DBW not working or even crashes when trying to use those features. In case of plane and cockpit 3d files or classfiles you should only get different versions of that plane and cockpit, but with incompatible DiffFM classfile or some other core parts of IL-2 you can easily break something.

[FANATIC MODDER]

Scanning #DBW folder took 10362 milliseconds.
Total number of modded files = 21853.
Sorting modded files list took 5,038 milliseconds.
Removing 337 Duplicates took 0,449 milliseconds

Look, 337 duplicates already.

[FANATIC MODDER]

I did a careful cleaning of my DBW folder and by deleting around 500 MB (of extra skins I 've put in, plus some double classfiles) I saved around 500MB. Then I opened up the wrapper and the results were:


Scanning #DBW folder took 185 milliseconds.
Total number of modded files = 20012.
Sorting modded files list took 4,552 milliseconds.
Removing 616 Duplicates took 0,507 milliseconds.
Total files opened = 383120
Total search time consumed = 12,682 milliseconds (0,012681907043 Seconds)
Search Time per File = 33,102 nanoseconds (0,000000033102 Seconds)
Average Search Iterations required per File = 8,0

How is that possible, to have 616 dublicates after such a clean-up?

[agracier]

How is that possible, to have 616 dublicates after such a clean-up?

I don't think that skins have anything to do with being considered duplicates ... skins are only when and if you choose them in a mission or in QMB ... otherwise they are not loaded at startup. Man, what a loading time that would require with some of the skin collections ...

Besides, when skinning you can add new skins to a plane constantly, without leaving the game. That way you can quickly view your mistakes. Which shows that skins are not loaded at game startup.

[SAS~Storebror]

How is that possible, to have 616 dublicates after such a clean-up?

My dearest "fanatic" modder (your nick tells it all ):
You didn't try to tell us that cleaning your DBW folder resulted in twice as much duplicates then before, did you?
See I coded the wrapper, I know what it's doing, and I can tell you the wrapper ain't the christmas tree, there's nothing to conjure by it.

As a matter of fact, duplicates reported by the wrapper are just that.
For instance if you have two files like these:

• X:\Your_IL2_Game_Folder\#DBW\MOD_A\subfolder_1\subfolder2\file_a.msh
• X:\Your_IL2_Game_Folder\#DBW\MOD_B\subfolder_1\subfolder2\file_a.msh

This is a duplicate, and that's exactly what the wrapper counts.

I just checked my own massive modded DBW installation, I have 15.384 files in there with no duplicates at all.
Don't ask me how you get that many duplicates, but you're damn close to FUBAR your installation for sure, which gets us back to your nick

Best regards - Mike

[agracier]

I'm probably going to revel my ignorance here, but a question. When the wrapper removes duplicates, what kind of file types are that?

You give an example of a ...msh file, but to my knowledge, every newly added mod plane has about 200 msh files in it's respective folder, and for every plane they have the same name.

An Ha-1112M has a msh file named 'Engine1_D0.msh', 'Engine1_D1.msh' ... and so on

So does a Tri-Motor, a Hawk-III and so on ... with some 20 planes added to the default DBW 1.6, that would give a few thousand doubles, not the 300 odd I got.

So I'm missing something, haven't understood something ... or whatever.

Or does it really matter very much?

[SAS~Storebror]

It's not just the filename that counts, it's the whole filepath underneath the mod's folder (which is kinda "root" from the wrapper's point of view).

X:\Your_IL2_Game_Folder\#DBW\MOD_A\subfolder_1\subfolder2\file_a.whatever
X:\Your_IL2_Game_Folder\#DBW\MOD_B\subfolder_1\subfolder2\file_a.whatever
is a duplicate since the modded file's relative path is the same for both ("subfolder_1\subfolder2\file_a.whatever").

X:\Your_IL2_Game_Folder\#DBW\MOD_A\subfolder_1\subfolder2\file_a.whatever
X:\Your_IL2_Game_Folder\#DBW\MOD_B\subfolder_1\subfolder3\file_a.whatever
is no duplicate since the modded file's relative paths differ:
subfolder_1\subfolder2\file_a.whatever
subfolder_1\subfolder3\file_a.whatever


Best regards - Mike

[FANATIC MODDER]

I deleted the following files:

1Sounds_Collection

00_Wolfighter_PTOPilots_V1

00_Wolfighters_RAFPilots_V1

00WolfightersLWPilotModelV1.1

1_Wolfighter_NewPilots_V1.1

and suddendly:

Scanning #DBW folder took 128 milliseconds.
Total number of modded files = 16592.
Sorting modded files list took 3,698 milliseconds.
Removing 400 Duplicates took 0,451 milliseconds.
Total files opened = 93812
Total search time consumed = 5,369 milliseconds (0,005368851125 Seconds)
Search Time per File = 57,230 nanoseconds (0,000000057230 Seconds)
Average Search Iterations required per File = 8,4

[BT~Tarik]

It's not just the filename that counts, it's the whole filepath underneath the mod's folder (which is kinda "root" from the wrapper's point of view).

X:\Your_IL2_Game_Folder\#DBW\MOD_A\subfolder_1\subfolder2\file_a.whatever
X:\Your_IL2_Game_Folder\#DBW\MOD_B\subfolder_1\subfolder2\file_a.whatever
is a duplicate since the modded file's relative path is the same for both ("subfolder_1\subfolder2\file_a.whatever").

X:\Your_IL2_Game_Folder\#DBW\MOD_A\subfolder_1\subfolder2\file_a.whatever
X:\Your_IL2_Game_Folder\#DBW\MOD_B\subfolder_1\subfolder3\file_a.whatever
is no duplicate since the modded file's relative paths differ:
subfolder_1\subfolder2\file_a.whatever
subfolder_1\subfolder3\file_a.whatever


Best regards - Mike

So that means that almost every plane installed has some duplicates ?

Because there is always
X:\Your_IL2_Game_Folder\#DBW\plane1\3do\plane(or cockpit or arms)\name of plane\Something D0 (like engine, gear etc)

Is it possible to rename one of these folders (like plane, or cockpit) without causing errors ? Because if I understand right if the path differs it is not seen as a duplicate.

[FANATIC MODDER]

I don't know it works, but the mod enabler (jsgme) somehow disables them. I thought before Storebror's answer that the problem was strictly in the classfiles, but today i discovered for your own good ALWAYS use Jsgme, that is convert a mod to DBW, SAS, UP etc form (it's very easy indeed) and then use the enabler.I am already down to 245 duplicates....

[SAS~Storebror]

I deleted the following files:
(...)
and suddendly:
(...)

...which should tell us what?

So that means that almost every plane installed has some duplicates ?

No. As I told you, I don't have a single duplicate in my modded DBW, which contains a whole lot of additional aircrafts.

Because there is always
X:\Your_IL2_Game_Folder\#DBW\plane1\3do\plane(or cockpit or arms)\name of plane\Something D0 (like engine, gear etc)

See, as long as anything coming after "X:\Your_IL2_Game_Folder\#DBW\plane1\" is different, the file is not treated as a duplicate.
Usually each plane at least has a distinctive "name of plane", hence the contents aren't duplicates.

Is it possible to rename one of these folders (like plane, or cockpit) without causing errors?

No.

See, the duplicates themselves aren't an issue on their own.
It's quite common for mods to include some additional files as "basic requirements". In this case those files might have been part of other mods already.
As long as all duplicate files contain the same contents, there's no issue at all.
On the other hand, if the contents differ, you must be aware that only that single file which resides in the mod which's foldername is first in alphabetical order will be accessed, the others are simply ignored.
This by the way has been the case since day 1 of mod enablers, all wrappers did so, even back in the days of IL-2 4.07m, they just didn't tell you about it.
There's no way to circumvent this.
If you install two mods sharing the very same file, then those mods are potentially in conflict.

Best regards - Mike