+  RHDN Forum Archive
|-+  Romhacking
| |-+  ROM Hacking Discussion
| | |-+  Release: ScriptCrunch v1.0!
Pages: 1 [2]
Author Topic: Release: ScriptCrunch v1.0!  (Read 1164 times)
Klarth
Guest
« Reply #15 on: December 07, 2006, 04:46:41 pm »

It'd take me at least half an hour to program some ugly as sin GUI in win32api (since I made the project in C++ and it'd be a pain to put it into a DLL and use C#) that is basically a property sheet editor which needs code to export/import the configuration file.  Why bother with that when the editing the ini directly is fast and less code?  More time to focus on other features...such as getting substring analysis methods up to par, but I don't think I'll be able to.

Obviously picking the substrings out is using a terrible algorithm to tackle the problem since the dictionary beats it out...and I'm not even including spaces in the dictionary method, which could very well save a few more % if I properly pick between which spaced version to use in the script, such as "word", " word", "word ", or " word ".
Klarth
Guest
« Reply #16 on: December 07, 2006, 05:33:17 pm »

Woo...first success in having the Substring+DTE method coming out on top of the Dictionary+DTE method!
However it didn't come from any algorithm change, but rather how I used the algorithm.  I increased the minimum size and look at the results:

Dict(3,14,512)+DTE(128) - 94735 (41.5%)
Dict(4,14,512)+DTE(128) - 98202(43.0%)  // Larger minimum size increases dictionary method by a bit
Dict(5,14,512)+DTE(128) - 97795 (42.9%)

Substring(3,14,512)+DTE(128) - 91661 (40.2%) 284s
Substring(4,14,512)+DTE(128) - 102448 (44.9%) 413s
Substring(5,14,512)+DTE(128) - 105502 (46.2% 578s  // Larger min size increases the compression by a good deal!
Substring(6,14,512)+DTE(128) - 105470 (46.2%) 726s // Slightly worse for the ff6 script..and 12 minutes to analyze. -_-

The gains come from giving the DTE larger stretches of text to work and it works very well for the repetitive 3-4 letter words. 

Then again, there's the part where it takes 5-12 minutes for the good compression results and if you want to get the best...you probably have to play with the settings and take a lot longer.

I really need to find a method to adjust the frequency results without screwing up the count.  I've mentally flirted with a few methods for this, but I'm not really sure which would be sufficient and not overly complex to code.
Kitsune Sniper
Guest
« Reply #17 on: December 10, 2006, 01:02:38 am »

...

This thing pukes all over my Samurai Pizza Cats script! DTE works fine, but DTE+Dictionary kills the program. It outputs the outputtest.txt file fine, but after that, bam, it crashes.

I'm guessing it's because only half the script is insertable. I dunno.
Klarth
Guest
« Reply #18 on: December 10, 2006, 02:02:56 am »

Probably because there aren't enough dictionary entries to fill the dictionary size you specified.
This is fixed for the next release.  I just need to add outputting for DTE/Dictionary tables in a script insertable format.

The mock insertion just fails if there are missing characters from the table and it can't insert.  Everything else should run fine in that case, minus script insertion statistics output (obviously).

On that note, I guess I'll release the next one either tonight in a few hours or Sunday night.
« Last Edit: December 10, 2006, 02:27:13 am by Klarth »
Klarth
Guest
« Reply #19 on: December 10, 2006, 10:08:58 am »

Version 1.0 is out!  Check the first post for the changelog, if you haven't already.

I believe it's finished unless a bug creeps up and it's certainly good enough to use on game scripts.
Kitsune Sniper
Guest
« Reply #20 on: December 10, 2006, 01:59:06 pm »

So uh... did you add the "ignore words/phrases" feature or not?  Grin
Klarth
Guest
« Reply #21 on: December 10, 2006, 02:14:58 pm »

Yes, it was in the preview version too.  Read ScriptCrunch.txt on how to use it.  :p
Kitsune Sniper
Guest
« Reply #22 on: December 10, 2006, 02:46:02 pm »

Quote from: Klarth on December 10, 2006, 02:14:58 pm
Yes, it was in the preview version too.  Read ScriptCrunch.txt on how to use it.  :p
TLDR!
Klarth
Guest
« Reply #23 on: December 10, 2006, 02:49:38 pm »

There are lots of features!  Not my fault you didn't read!
Pages: 1 [2]  


Powered by SMF 1.1.4 | SMF © 2006-2007, Simple Machines LLC